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The activity which is the subject of this 
report was supported in whole or in part by 
the U. S. Office of Education, Departmr:>nt 
of Health, Education, and Welfare, 
However, the opinions expressed herein do 
not necessarily reflect the position or policy 
of the U. S. Office of Education, and no 
official endorsement by the U. S, Office of 
Education should be inf^^rrt J. 



SAM EMPLOYER PROJECT 



mTRODUCTION 

"It is almost universally agreed that information about students after they leave 
coDege is important to a college in evaluating its programs and in planning for the 
future. It is also almost universally agreed that the task of obtaining "follow-up" 
information that is i-eliable, valid and useful is a difficult one." This statement 
introduced the August, 1974, report of the Improving Occupational Student Follow-up 
in California Community Colleges project. That project, popularly called SAM 
(Studant Accountability Model), was an outgrowth of two concerns: (1) the Vocational 
Education Act requirement that colleges report annually the number of students who 
completed occupational programs and found employment in the field for which they 
were trained, and (2) the identification through COPES (Community College 
Occupational Programs Evaluation System) of "systematic foUow-up of students who 
have completed occupational programs" as the lowest rated item of sixty used in 
evaluating community college occupational programs based on a stratified random 
sample of eight California community colleges reviewed in 1972-73. 

In its first 1973-74, project year, SAM developed a modal that could be implemented 
by community colleges and provide a consistent and systematic guideline for student 
follow-up. The Model consisted of two components. The first, the Accounting 
Component, classified occupational courses and identified and categorized 
occupational students by major. The second, the Follow-up Component, 
recommended procedures for obtaining information from students after they left the 
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college. A variety of materials were developed to assist colleges with 
implementation of the SAM Model. During the 1974-75 project year, emphasis was 
placed on dissemination and training of local college personnel. Emphasis is being 
placed on field testing the Model and extending the system to non-occupational 
majors in the current project year. * 

Early in the development of the Model, it was determined by the SAM Consortium; 
Dr. William R. Morris, sponsor representative. Chancellor's Office, California 
Community Colleges; and Dr. Ben K. Gold, Project Coordinator; that designing 
procedures for obtaining employer feedback was a next essential step of follow-up. 
Consequently, an Employer Follow-up Project wag proposed and funded for 1975-76. 
Although written as a separate project, the intent was that the eventual outcome 
would become an integral part of SAM. Hence, SAM Employer Follow-up was to be 
closely monitored by the SAM Consortium, as well as its own Consortium. 

The Project focus was directed toward developing and testing a system for obtaining 
employer feedback information that could assist with occupational program review 
and evaluation. It was not anticipated or implied that hard data would be generated 
through the employer follow-up field tests. The complexity of the task was 
recognized by all persons involved with the project. Enthusiastic support for the 
concept and the importance of opening lines of communication between employers 
and occupational program educators was almost universal. 

Sponsored by the Chancellor's Office, California Community Colleges, the project 
was based at the San Jose Community College District. Shirley E. McGillicuddy, 
Shirley McGillicuddy and Associates, Sierra Madre, California was retained as the 
Project Coordinator. 



ACKNOWLEDGMENTS 

Many individuals and four California community colleges provided valuable assistance 
and support for the project. Specific mention should be made of Dr. William R. 
Morris, Evaluation Specialist, Chancellor's Office, who served as sponsor 
representative and provided creative expertise and leadership. Also, Dr. Ben K. Gold, 
SAM Project Coordinator, who was an excellent resource, especially in providing 
guidance and direction to keep the project consistent with the aims of SAM. Others 
were San Jose Community College District's Board of Trustees and Chancellor Dr. 
,Otto Roemmich; Dr. Paul P. Preising, District Director, Grants and Research, who 
served as management representative and provided leadership for the project design 
and conduct, as well as the SAM Employer Follow-up Consortium and SAM 
Consortium members who (Shown as Appendixes A and B) gave thoughtful attention 
and guidance to the project. 

The four Community Colleges Districts who field tested Employer Foliow-up were 
instrumental in identifying the project conclusions and recommendations for future 
implementation. Consequently, particular appreciation is extended to: 



Foothill-De Anza IJistrict 

Dr. Nathan H. Boortz 

District Director for Technical Education 

Mary Kecskemeti, Staff Assistant 



San Jose City College 
Dr. Lois CaUahan 

Former Dean of Occupational Education 
Dr. G. S. Ohanneson 

Assistant Dean of Occupational Education 



San Diego District 

William Steinberg 

Assistant Chancellor 

David Neel, Vocational Education 

Coordinator 

Shasta College 
Walter Brooks 

Vice-President Student Affairs 
Eve-Marie Arce 
Field Test Coordinator 



Gratitude should also be given to the thirteen sample community districts who 
provided open and candid comments that served as an information base for project 

design decisions, as well as all the many individuals at the six college campuses who 



participated. 



3 8 



OBJECTIVE III 



9 



ERIC 



OBJECTIVE 



Develop by July 1, 1976, a system for collecting feedback information C?om 
employers of community college occupational education completers. 

In addition to the objective, the project proposal specified that the employer follow- 
up system must be: 

j . Compatible with SAM (Student Accountability 

Model). 

^ — 

Based on what community college educators 
need to know to assess, modify, and change 
programs and on what employers are willing 
to disclose. 

Guided by a Consortium of employers and community 
college educators. 

Monitored by the SAM Consortium. 

Flexible and simple for easy application to individual 
community college district needs. 

V 

Tested and ready for implementation. 

The objective and accompanying conditions became the basis for the project design. 
A Flow Chart, Schedule of Major Activities and Employer Follow-up Field Test summary 
^ are shown as Tables I, n and III. 4 j 0 
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PROJECT OBJECTIVE: 
TAni.E II] 
SITE 



Develop add tL'Sl ;i syst(vn for ohlmiiiiy Ijniiloycr f(! 
on coininiinity collciiD.occiipationiil lr,'iiiiii\; proi^niiiis. 



SA M llmployor Follo^-iip Field Tests 
Idil) 



Foolhill-Dc Anza District 
De Anza College 

Foolhill College 



San Diego District 



Mesa College 



Miramar College 



San Jose District ■ 
San Jose City College 



ShQSta*Tehiiiiiii'Trinity 
Joint District 
Shasta College 



. Ohtiiin (Miiployor ImtMi on 
, effcL'livofiossof oceupaliontil 

ediHMtioii iiiul lr(iinin<jprogriinis, 
. Incorponile information with 

ongoing program review ml 

modi fica lion processes. 
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. Establi* an indication of overiiri 
instructional effectiveness iji 
selected occupntionul programs 
by conducting an employer follow- 
up study of June, 1975 graduates. 

. Develop vehicle to facilitate 
articulation with employers to 
provide needed program/course 
revisions. 

. Provide an opportunity for in- 
struelional/follow-up personnel 
to interact directly with industry 

, Collect cfnploycr data in sVfTicrcfTt ' 
depth to sliinuliite program im- 
provomenl as indicated 



, Develop an acwiile doseriptiofi" 

of lai-get jobs, 
. Develop job niarkdts for fnturr 

program complclers. 
. Modify existing cdiicational 

prognun to bettor conform to 

curriMit industry rquiremtMils, 



De An/a 
AiiloTech 

l'lioliy\,i;)hy. Physical 
Tliifapy ' 

Foothill ■ 

Ornamenlil Horticulture 
lilectronics 



1!\1PL0YH1{ 

SAM student Follow-up 
Respondents, additional 



CONTACT METHOD 
Auto Tech (Pre-sorviee) 



Mesa 

Electronics Technology 
Miramar 

Aviation Maintenance 
Technology. 



Flocti'onics 



I'/incatiori (low completioit) 
t^onipnler Science/Key 
Puncli Operation (Rapid 
Todinnlogy dmngc) . 
Truck Driving (Newly 
initiated fortificatp 
Program), 



FIcclronics, Photogmphy 
student follow-upjaculty I Mailed letter with questionnaire, 
fl^'^i'^'anco. I preceded or followed by telephone 

call, telephone follow-through 
and telephone interview. 
Auto Teeh (In-service) 
Mailed letter with questionnaire, 
preceded or followed by telephone 
call and telephone interview. 
Physical Therapy 
Mailed letter with questionnaire, 
telephone follow-through. 
Ornamental Horticulture 
Mailed letter with questionnaire, 
possible telephone alert, telephone 
jollovi'H[hrou^ 



SAM Student Follow-up 
Dcgpoe ori^ertificate 
Respoiiuoiiis and additional 
student Iclcplionc contact 
to obtain inquiry per- 
mission. 



SAMSUidont' Follow-iip""" 
Respondents andndditional 
follow-up by mail and 
telephone to assess pre- 
paration and to obtain 
inqiiiry permission. 
"S/VM^tudcnfFollow-up 
Respondents, 



Telephone and personal contact 
with employer (immediate supervisor), 
(rieolronies, Placement Interviewed; 
Aviation Maintenance, Instructors 
Interviewed). 



i 



Mailed letter with questionnaire; 
telephone follow-up to completn 
survey data with employer 
(direct supervisor). 



Mailed Irtlnnvitti prolliffinary'' 
qnrstionnairo. Follow-up 
porsnnai in)ervirw. 
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FINDINGS AND CONCLUSIONS 

At the outset, it was acknowledged that developing a systiam or model for Employer Follow- 
up would not be a simple task. Project experiences reinforced this premise and underscored 
the need for flexibility within the system to meet local college and specific occupational 
program needs and conditions. 

The project did develop and test a system and some alternate options for obtaining feedback 
from employers of community college occupational education former students and responded 
to the conditions established for the system. The intent was to identify a method for 
obtaining employer feedback on the occupational preparation provided by the college that was 
flexible, relatively simple, and feasible for community colleges. That feedback, along with 
input from other contacts with employers, students, and college personnel was to be utilized 
in reviewing and evaluating occupational programs and in making management decisions. The 
process was refined to the extent that it can be used by a college to guide an employer 
follow-up study as an additional component of SAM and undergo further testing and 
refinement. 

Project activities isolated some obstacles or problem areas that need to be addressed in 
employer follow-up. Activities also led to some possible conclusions about employer follow- 
up» These two areas are treated in this section of the report. Specific situations encountered 
in each field test that were the basis for consensus conclusions are detailedMn the individual 
reports of the four tests and are shown as Appendixes C through F. (Appendix C, Foothill-De 
Anza District; Appendix D, San Diego District; Appendix E, San Jose City College; and 
Appendix F, Shasta College). 

Problems Identified 

Compatibility with SAM (Student Accountability Model) was a major consideration in the 
development of the Employer Follow-up system. Identification of employers through SAM 
Student Follow-up surveys was a practical 'integrated systems" approach. However, the 
approach relied on the dumber of students responding and the information provided. 
Cronsequently, employer follow-up was affected by progress and results achieved through SAM 
at the four test sites and the two systems shared some common problems, ft is important to 
know and emphasize that 1975-76 was a pilot test year for the SAM system. 

^18 



Percent of students responding to follow-up needs to be improved to develop a 
significant number of employers from which to gain feedback. None of the test sites 
had prepared students for the follow-up surveys, the importance of their participation, 
and the use of the information before the students left the campus in the spring of 
1975. In the employer follow-up field tests, instructor input and additional student 
follow-up contacts were utilized to increase the employer contact lists. As colleges 
develop student understanding of and orientation to follow-up response levels should 
increase. Foothill-De Anza District, for example, has set a goal of 75-80% student 
response for 1976. All four test sites plan to prepare students for follow-up before 
they leave the campus. 

Student mobility, both geographical location and job change, was a significant factor in. 
tracking students and, consequently, employers (see San Jose and Foothill-De Anza 
reports). Mail, telephone, and "house call" efforts to locate students were time 
consuming and not particularly successful. Evening or weekend telephone contacts 
were necessary to reach employed former students. Job mobility was further 
complicated by the seasonal aspects of employment in some occupations, e.g., 
ornamental horticulture, photography. 

The student follow-up questionnaire needs to be designed to facilitate employer 
follow-up. This would include collecting such information as: employer name and 
address, the immediate supervisor of the former student, and the job title for the 
position held by the former student. 

Student follow-up computer print-outs need to be organized by program rather than an 
alphabetical listing (see Foothill-De Anza report) to simplify employer follow-up. 
Names of individual program completers had to be manually pulled from the computer 
print-out lists which introduced an additional time-consuming step. 

Obtaining student permission to contact the employer was a major obstacle to 
employer follow-up. This step was advised by the Employer Follow-up Consortium and 
community colleges. It was included in three of the test sites and involved extensive 
effort to contact the former student by mail or telephone to gain pemission to contact 
the employee. When permission was not given, it reduced the number of employers 
who could be surveyed. No employer contacted in any of the four sites asked the 

19 
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college surveyer if the former student had authorized the inquiry. One test site did 
not request student permission to contact the employer and experienced no problems. 
Since the intent of the feedback is program rather than personal performance oriented, 
it is ;ijuestionable if the privacy right is an issue. Future employer follow-up should 
consider eliminating the requirement for student permission to contact the employer. 

Small programs or programs with low enrollment provide a limited sample of both 
students and employers. To achieve significant information about program quality and 
relevance, it may be desirable for some occupational programs to conduct fo)Iow-up 
surveys over a two-year period with more than one class (See San Diego report). 

Conclusions 

Employer follow-up in some form was viewed positively by community colleges. All of 
the districts/colleges sampled in a survey to provide an information base for the 
project (see Appendixes G and H) and all four districts participating in the field test 
favored some form of employer follow-up to provide input to program. 

Employers sampled responded favorably to the request to provide input to college 
occupational education programs. The positive aspects of employer response were one 
of the consistently outstanding experiences of the field tests. 

Many employers sampled did not have first-hand knowledge of what a community 
college occupational training program encompassed and, therefore, could not react to 
training without identifying the program through tieing it to the knowledge and skills 
that a specific employee(s) brought to the job. 

Employer follow-up should be utilized as a "formalized" supplement to other types of 
employer contact and involvement, e.g., needs assessment, advisory committees, 
technical seminars, field trips. Employer follow-up surveys may expand and enrich 
these other forms of interaction. Employer follow-up may further assist a college in 
evaluating other activities, e.g., in two of the field tests, it was indicated that 
advisory committee composition might be reviewed especially in relation to the 
practice of including only representatives of middle and upper management. Employer 
follow-up contacts were made with the former student's immediate supervisor - often 
a line employee, which appeared to provide a different reference for input. 



EKLC 



3 20 



Clearly defined institutional objectives and priorities should guide employer follow-up. 
Three of the four test sites identified objectives they wished to accomplish (see Table 
III) in addition to the project objective. The objectives influenced the program 
selection, contact method, instrument design, personnel involved, and dissemination 
plans. 

Program selection should be based on established priorities or criteria. Consideration 
might be given to programs that: have experienced rapid technology change, are new, 
have marginal enrollments, have been identified by the advisory committee or staff as 
in need of 'revision, have low placements, and have shown evidence of needing 
' "expandird'Tnte^^^^ "staff and employers. Program selection 

priorities become particularly essential in view of the apparent impracticality of 
conducting employer follow-up surveys annually for all programs. 

Participation and involvement of program staff is highly desirable if program change is 
to be an outcome. Early involvement of program personnel in determining objectives 
and designing an instrument tailored to the specific occupation was an added strength 
as was evidenced by two of the four field tests (see Foothill-De Anza and San Diego 
reports). 

Consideration could also be given to involving program staff in employer follow-up 
contacts (see San Diego report). Time available and the possible introduction of bias 
should be a consideration in involving staff in this phase of employer follow-up. 
Program staff involvement in the use and analysis of information generated through 
employer follow-up is^essential. 

. Some form of personal contact with employers, i.e., telephone or personal interview, 
^Vs favored by all four test sites. Telephone contacts (see Foothill-De Anza and San 
.Jose, reports) were felt to be the most cost effective methods by two of the sites. 
Personal interviews as the contact method selected by two of the sites (see San Diego 
and Shasta reports) supported specific objectives identified for the employer follow-up 
. tests. 

Qualifications ar.d training for interviewers should be an integral part of the planned 
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approach to employer follow-up. In the four test sites, a variety of persons were 
utilized to contact employers including instructors, placement staff, classified 
employees, and outside consultants. Persons selected for employer contacts, as was 
previously indicated, will be influenced by the objectives for the survey. Consistency 
through training personnel in interview techniques was believed to be essential. 

Employer follow-up may result in additional benefits to the college and the program. 
These should be considered in analyzing the cost effectiveness of the system. Included 
would be such advantages as expanded dialogue with employers, identification of 
resources, assessment of future work experience stations and placement opportunities, 
and improved employer relations. 

An employer follow-up procedures manual should be developed to assist local colleges 
wKh implementing a system that builds on the experiences gained through the project. 
The manual would suggest steps involved in planning and implementing employer 
foUow-up, include sample questionnaires, and identify some of the problems that may 
be encountered and possible solutions. If employer follow-up is to become a 
component of SAM, the manual should be an integral part of the SAM materials and 
possibly could be included in the SAM Manual which is scheduled for revision in the fall 
of 1976. ■ 

Project experiences also led to some tentative conclusions about employer follow-up. 
These might appropriately be given consideration in future experimentation and 
Afinement of employer follow-up systems. 

College programs and departments who share a common interest in employers may 
provide a vehicle for employer contact and might be more integrally involved iu the 



system. Included would be such entities as work experience, placement, counseling 
staff. -Cross-level involvement was touched on in the field tests, and would appear to 
offer advantages and avenues for implementation that were not explored fully. 

Additional means of obtaining expanded employer involvement in the follow-up process 
such as industry or trade association support, utilizing the personnel department of 
large organizations to distribute and collect information, might be explored. In some 
instances (see Foothill-De Anza report) reaching the line supervisor in a large company 
was difficult. 

Continued attention needs to be directed toward identifying a simplified, direct, and 
efficient :ystem for gaining employer feedback. Flexibility and adaptability to varying 
local r^cnditions and needs such as t^pe of occupation, employer availability, and 
geographic location of the college and employers are essential ingredients of the 
system. 

Timing for employer follow-up tests was governed by timing of SAM student returns 
and advisement from the Employer Follow-up Consortium. It was felt that 
approximately six months after employment was appropriate because; 1) employer 
probationary periods are generally six months; and 2) it would still be possible to 
separate skills brought to the job from those learned on the job. However, there were 
some indications that this time sequence does not provide adequate opportunity for a 
former student to utilize more advanced training gained through college programs. It 
may be advisable to explore follow-up after a longer period of employment or two 
stage follow-up to sample entry level as well as more advanced employment 
proficiencies. 
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Correlation between employer and student perceptions was explored on a limited basis 
in the San Jose City College tests. Expanded efforts to compare perceptions of 
students, employers, and college personnel should provide a more complete picture of 
occupational training provided through college programs. 

Initial employer follow-up surveys may best be used to provide "indicators" of 
programs that are in need of more indepth study before major progrem modification 
and change would take place. An indepth follow-up study might utilize a task analysis 
approach (see San Jose report) that links specific skills with occupational courses and 
correlates student and employer perceptions. 
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MAJOR STEPS IN PROJECT DESIGN AND CONDUCT 

Although many of the major activities of the project overlapped and were going on 
simultaneously, each step for clarity of description in the written report is discussed 
in the sequence identified in the schedule. 

Project Planning and Design Since the project was housed at the San Jose Community 
College District, the SAM Project was based et Los Angeles Community College, and 
the Project Coordinator w.-s located in Sierra Madre, California, it was important to 
clarify early the working snd reporting relationships that would be maintained. In 
August, the project management representative, Dr. Paul P. Preising; SAM Project 
Coordinator, Dr. Ben K. Gold; the sponsor representative for both SAM projects. Dr. 
William R. Morris; and the Employer Follow-up Project Coordinator, Shirley B. 
McGillicuddy, met to chai I the course of events and to establish clear understanding 
of the objective, the anticipated results, the constraints, and the fiscal management 
and controls that would be applied. 

Subsequently, the Project Coordinator developed the more detailed plan for the 
project approach, the budget, and the schedule for modification and/or approval. 



Search for Employer Follow-^lip Studies and Experiences Dr. Benn K. Gold had done 
extensive research on follow-up studies that had been conducted by educational 
institutions in California aitd in other states as an information base for SAM. He was 
an excellent source of follow-up information. Pertinent studies available from Dr. 



Gold and listed with ERIC (Educational Resource Information Center) were reviewed 
as a basis for developing a system for employer follow-up. A Bibliography of 
literature reviewed is shown as Appendix J. 

What Colleges Need To Learn From Employers In order to answer the question, 
"What do community colleges need to learn from employers of former students?", a 
survey of California community colleges was undertaken. Rather than a mail survey 
of till colleges, it was felt that more valuable information would be gained through a 
personal visit and interview. A representative sample of colleges was selected by the 
sponsor representative and the SAM Project Coordinator. Colleges were divided into 
eight cells according to occupational education ADA and geographic location. 

A data gathering instrument was developed to guide the interviews and insure 
consistency in information collected. Dr* Nathan H. Boortz assisted with the college 
survey, contacting all of the northern colleges. The thirteen districts (representing 
seventeen community colleges) interviewed are shown as Appendix G. The objectives 
for the interviews were to collect (l) information aboul district/college experiences 
with employer follow-up; and (2) input the district/college needed from employers to 
review and evaluate programs. Interest and willingness to participate in an employer 
follow-up field test was also determined. Colleges were cooperative and receptive 
and provided valuable observations and suggestions for the project. An abstract of 
information gained through the interviews with sample colleges is shown as Appendix 
H. 

Employer Follov;-up Consortium The project proposal specified that a Consortium 
guide and evaluate the. project.. Leaders from community colleges and employers of 
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community college occupational students were invited by the Chancellor's Office, 
California Community Colleges, to serve as Consortium members. Five college and 
nine employer representatives accepted the invitation. Because of extensive 
commitments and busy schedules, it was net possible for all individuals to participate. 
Persons who were involved in the Consortium activity are shown as Appendix A. 

The Consortium was a good resource for the project and meetings provided an 
excellent platform for interaction between educators and employers. Four meetings 
were planned to obtain Consortium advisement at major points in the project 
progress. Subsequent adjustments in the project schedule caused the Consortium to 
recommend consolidation of the third and fourth proposed meetings. Dates and major 
focus for each meeting were as follows: 

December 16, 1975 Reaci to needs assessment (college survey and literature 

search) information in relation to employer response to 
information requested. Advise on design of preliminary 
model. 

March 2, 1976 Review preliminary model and field test plans and procedures. 



June 3, 197& Review field test experiences and findings and advise on 

employer follow-up recommendations. 

SAM Consortium 

* The SAM Consortium was charged wHh the responsibility for monitoring the project. 
It was utilized as a valuable resource to advise on the development of an employer 
follow-up system and to maintain compatibility between employer follow-up and the 
SAM Model. SAM Consortium members are sh^^ Appendix B. 
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The Project Coordinator attended SAM Consortium meetings to report progress and 
gain input. This approach provided additional valuable advisement an ] helped to 
identify refinements that would need to be stressed in the SAM Model to provide an 
information base for employer follow-up, for example, student identification of 
employment supervisor, address, and telephone. The student follow-up pilot tests (in 
process during the 1975-76 year) had not necessarily been designed to accommodate 
the added component of employer ToUow-up. 

The SAM Consortium was supportive of the employer follow-up component and 
provided an added dimension of expertise to advise on and monitor t!if? project. 

Dev^^l opment of Preliminary Model Utilizing information collected through the 
literature search, the sample California community college survey of employer 
feedback methods and input needed from employers, and the advisement of the 
Employer Follow-up Consortium and the SAM Consortium a preliminary plan for the 
employer follow-up field test procedures and a sugg'^^sted instrument were developed. 

Emphasis was placed on the objective of gaining program feedback and not personal 
performance evaluation. A keen concern of community college educators and 
employers was employer resistance that might be met because of privacy rights. This 
element was introduced because of the anticipated need to assist employers by 
providing names of former students trained so they might more specifically identify 
preparation provided by college programs. To counter this anticipated objection, it 
was suggested that consideration be given to obtaining permission from a former 
student fc employer contact. 

4 
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Field test procedures id^tified the planning steos the college needed to take: 
objective(s), method, personnel assigned, time schedule, budget, requirement for 
outside assistance, description of data analysis and cont ol, and dissemination plans* 
A copy of the field test procedures is shown as Appendix I. 

The preliminary instrument was general and not oriented to specific programs. 
Hc veViP, it established some categories of information to be obtair^^i from 
employers as well as a suggested format. The instrument was used as a guide by the 
field test sites in developing questionnnaires for specific prfl^rams. 

Suggested employer probes dealt with technical skills, pre-employment skills, 
interpersonal skills, importance of college training to the hiring decision, whether a 
former student would be hired for a future job opening, and an identification of 
program strengths and needs for improvement. Both rat^ and open-ended questions 
were sy^^^ted. 

Field Tests Criteria were developed for site selection for field tests. Priority 
consideration was given to the district/college progress in implementing the SAM 
Follow-up component and identifying employers of former students. Additionally, the 
district's willingness to participate in the field test and the availability of personnel 
to coordinate the test were important. It was also believed to be of value to select 
test sites that had determined some specific local objectives for conducting employer 
follow-up and that would offer some variation in experiences, e.g., urban or rural 
setting, program selection. 

Four districts were selected for field test participation* All four districts had 
completed application of the SAM Follow-up component with non-continuing students 
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from spring. 1975. the districts included: Foothill-De Anza, San Diego, San Jose, 
and Shasta-Tehama-Trinity Joint District. 



Each district submitted a preliminary plan for approval. Limited financial assistance 
was made avnilable through the project to assist with the field tests. Although 
individuality and autonomy were encouraged in each test, since the intent was to 
develop a system for employer follow-up, it was important also to maintain some 
uniformity and control. Field Test Coordinators met with the Project Coordinator, 

the sponsor vepresentative, and the Employer Follow-up Consortium to resolve 

'I 

problem areas and identified concerns before the tests were conducted. 
.» 

In the four participating districts, six colleges and nine different programs were 

I 

represented. Threjs of^jfe four districts identified additional local objectives for 
conducting employer fplK-uP- Each test selected a contact method(s) that best 
' supported project and college objectives and the program for which follow-up 
_ information was being obtaiiied and could be implemented within existing constraints. 
It is important to emphasize that project time limitations for the tests imposed 
difficult restrictions for the districts. They were additionally affected by response 
levels from the student follow-up. The test sites, objectives, programs included, and 
the contact method used are shown as Tabel III on page 8 of this report. 

The Project Coordinator maintained contact with the sites during the field tests and 
visited each site to discuss findings and recommendations. Field Test Coordinators 
met as a group to enter into consensus discussion for future employer follow-up 
recommendations, and suggestions for planned dissemination. 



It seems necessary to point out that the data obtained through the follow-up system 
was not significant enough to make major program changes. However, the colleges 
were particularly sensitive to the data and this discrimination may lead to some 
future modification. 

Dissemination Project dissemination plans include the final report furnished in 
limited quantity to the Chancellor's Office, California Community Colleges, and an 
abstract for distribution to community college and employer audiences. A fact sheet 
built around frequently asked questions was developed during the project year for use 
with employers and educators. Employer Follow-up was included as a panel discussion 
in two SAM Workshops for California Community Colleges in June, 1976. Since the 
project is a component of SAM end plans for continuation are to integrate the system 
into that Model, additional dissemination is planned in conjunction with Project SAM. 
This includes a sound/slide presentation and an insert in the SAM Procedures Manual 
scheduled for revision in the Fall of 1976. 

Evaluation Continuous project evaluation was accomplished by the Employer Follow- 
up Consortium and the SAM Consortium. Additionally, the sponsor representative, 
Dr, William R. Morris; the management agency representative. Dr. Paul P. Preising; 
the Project SAM Coordinator, Dr. Ben K. Gold; and the Employer Follow-up Project 
Coordinator assumed ongoing responsibility for project evaluation. 
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SAM Employer Field Test Report 



INTRODUCTION 

The Student Accountability Model (SAM), Employer component, is being developed 
and field tested in four community college districts in California. This is a report 
of that field test as conducted in the Foothill~De Auza Community College District. 
The Project was funded through the California Community College Chancellor's 
Office with VEA, Part C monies and was managed by the San Jose City College 
District. Shirley McGillicud(ty, of Shirley McGillicuddy Associates, was the con- 
sultant to the Project. 

DISTRICT AND PARTICIPATING COLLEGE IDENTIFICATION INFORMATION 

District Name, Address, and Contact Person 

Foothill-De Anza Community College District 

12345 El Monte Road 

Los Altos Hills, CA 94022 

Contact Person: Dr. Nathan H. Boortz, Director 
Teeimical iEducation 
(415) 948-8590, ext, 517 

Field Test Coordinator 

Mrs. Mary Kecskemetl, Staff Assistant 

Office of Technical Education 

Foothill-De Anza Community College District 

Participating Colleges 

Foothill College De Anza College 

12345 El Monle Road 21250 Stevens Creek Blvd. 

Los Altos Hills, CA 94022 Cupertino, CA 95014 

(415) 948-8590 (408) 257-5550 
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METHODS 



Five discrete occupational programs were selected as the focus for this SAM field 
test project. As stated in the Field Test Plan, ''diversity rather than homogeneity" 
was the criterion for selecting the five programs for the pilot test. The programs 
were Electronics and Ornamental Horticulture at Foothill College and Automotive 
Technology, Photography and Physical Therapy Assisting at De Anza College. The 
Plan further stated that a value judgement made was that a single contact method 
is neither ideal nor appropriate for all programs. " Proposed, and subsequently 
carried out, was a "theme and variation" or eclectic approach tailored to meet time 
and financial constraints and to accrmmodate certain unique characteristics of each 
program and occupation as perceived by the program faculty members. 

Procedures actually followed for each program are displayed in Table I which indi- 
cates the original contact method plan, and to whi oh a column was added to show 
the methods actually used. 

As seen in Table I, four different methods were used in contacting employers: (1) 
a questionnaire mailed with a cover letter requesting response and return (see 
Exhibits "B," "D-1" and "D-2"), (2) a phone call stating the purpose of the. survey 
and soliciting employer cooperation in responding to a questionnaire which, with 
their concurrence, would be mailed (see Exhibits A-2, C-2, E-2 and F-2), (3) 
a questionnaire mailed with a cover letter stating that a plione interview would fol- 
low (see Exhibits A-1 & 2, C-1 & 2, E-1 & 2 and F-1 & 2) and (4) a telephone inter- 
view only. The cover letter attached to each questionnaire was signed by a depart- 
ment head or lead instructor. Alttiough planned as a last resort if all other methods 
failed, the personal interview method was not used. Planned follow-up measures for 
non-responding employers included a second questionnaire and phone oalL Since time 
v^as a critical factor in the pilot study only phone foUcw-ups were actually used. 

The original plan contemplated use of the postal service for sending all questionnaires. 
In the interest of time, continuing education stndents who were completing an Auto' 
Technology Clinic hand carried questionnaires to their supervisors for completion and 
return to the college. 
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TABLE I 



Planned vs. Executed Modes of Follow-up 
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Hethods Programs Planned Executed 



1. Hail program-tailored Auto Tech 

questionnaire with cover Pre-service 1,4(5) 2 or 3,4,6 

letter. In-service* . 2 or 3,6 



2. Phone call followed by Electronics 2,4 
mailed program-tailored 
questionnaire with cover 
letter. 



2 or 3,4,6 



3. Mail program- tailored Photography 2,4 . 2 or 3 4 6 
•questionnaire follovied by • ' 
phone call. 

4. Phone call foil gw Physical Therapy 1,4 1,4 
through on 1,2, and 3 

above. 

5. Personal Interview Ornamental 1,4(5) 1 or 3,4 
(if required) Horticulture 



6. Telephone Interview 
only.* 



*Not in original plan. ^ 
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FINDns^GS AND RESULTS 



"Findings"' are preceded by identifying problems encountered. The problems are 
enumerated below. 

1. The negative effects of the recession were compounded in one Occupation 
(Photography) where some kinds of jobs were found to be seasonal in 
nature. For all programs, Inadequate response to the SAM student 
questionnaire and separation from the job prior to hisAer employer's 
receiving the questionnaire resulted in a lack of authorization for 
employer contact and, a^ording to SAM Guidelines, a block to the 
process. Although a concerted effort was made initially to locate the 
student, explain the need for permission to contact his/her former 
employer, mail and receive the signed consent statement, contact the 
former employer, provide him/her with this evidence and secure a 
response, it was judged to be too cvimbersome and time consuming to 
pursue and the procedure was dropped. 

2. fii phone follow-ups a supervisor frequently stated that s/he did not receive 
a questionnaire. When this occurred, an immediate attempt was made to 
obtain responses via the telephone. Results in these instances were tabu- 
lated in the "fiiterview. Phone Only" category of Table I. 

3. Employer identification was the most formidable obstacle. Second mailings 
to students of the same questionnaire sent them in November, 1975 were 

— made and phone numbers of program completers were obtained from the 
^ two Registrar's Offices. Phone calls were made to those students during 
both day and evening hours. The number of former students thus contacted 
was still fewer than satisfactory because (a) much transiency has occurred 
on the part of former smdents and there is little or no knowledge of current 
whereabouts, (b) frequent rosponses indicated that individuals were neither 
seeking nor available for work, (c) in oome instances, where a former stu- 
dent was networking, s/he declined to identify or have the employer con- 
tacted and (d) ''SAM identified" completers for the five programs studied 
had to be extracted manually from the computer print-outs. 
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Survey results or findings, were j^|g|||||^by program and summaries 
are given in Tables n and HI A-1 through m-E. Summaries relating 
to job skills had a ^*usefalV heading inserted between the columns 
"Essentiar' and ''Non-essential": This was considered necessary in 
order to accommodate respondents who indicated a response some- 
where betv/een the two extremes. 
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TABUUIION OF DATA 



The jobs to which this tabulation of data applies range from a mechanic to service station attendant. 
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Automotive Technology • Pre-servlce 



ill-AI 



2. How important is formal Automotive Training in relation to other qualifications 
you cOiisider in making the hiring decision? 

10 Very important 3^ Moderately important 

Of little importance 2 Unimportant 

3. Would you hire another De Anza Automotive Technology graduate for a future job in 
your Organization? 

12 Yes No J_ Maybe 



OPEN-END QUESTIONS j 

What, in your opinion, is the major strength of the Automotive Technology training 
provided by De Anza College? • 

Our program teaches students to be professional and confident. 

Equipment/techniques are up-to-date 

The Automotive Technology Program instructors at De Anza College place great 
emphasis on the basic^ skills involved in this field. 

The students are trained to check all areas/possibilities of problems before 
starting work. 



A. 

c. 

D. 



What, in your opinion, is the greatest need for improvement? 

A. Students need more experience on the job. Possibly through a Work Experience 
Program. 

B. Cleaner and neater work — Flexibility in theory. (What is learned is not 
always a solution to field problems) Several opinions or ideas may prove 
more effective. 



What additional conments or suggestions do you have for De Arza's Automotive 
Technology program? 

A. The extra knowledge of duties such as those of a service station attendant, 
are helpful . 
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Automotive Technology - Pre-service III-AI 

\ 

Lack of comniuni cation between student and customer. Suggested more emphasis 
on speech and advertising classes. 

Students should be aware of^ the "business" aspect of the company. 

Better penmanship. Managers/supervisors have a hard time reading what they 
write on the work orders. 
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Automotive Technology - In-service 
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1. Do the clinics improve the confidence 
level of the mechanic? 
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2. Do the clinics improve a mechanic's 
ability to analyze problems? 
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2 




3. Do the clinics improve a mechanic's 
ability to take proper steps for 
correcting a problem? 


26 








4. Do the clinics broaden a mechanic's 
abilities? 


30 


i 







Total % 90% 8% 2% 



OPEN-END QUESTIONS 

What, in your opinion, is the greatest need for improvement in the 
Automotive Technology training program prt-^vlded by De Anza College? 

1. Up-to-date data/equipment 

2. Instructors very thorough in teaching the basics 

3. Students' training is applicable 

4. Majority of graduates very confident 

What, in your opinion, is the greatest need for improvement in the Automotive 
Technology training program provided by De Anza College? 

1. Very few advanced classes 

ERIC - ^ 



Automotive Technology - In-service 



III-A2 



2. "Need bigger variety of materials from different manufacturing 

companies (i.e., carburators, fuel engine systems, electronics 
fuel injection) 

3. Possibly add more labs to the program (to help students apply 
knowledge) 
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ELECTRONICS PROGl'^AM 
TABULATION OF DATA 



Job title: Lab technician 
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Electronics 



2.. How important is college level electronics traini:^g in relation to other 
qualifications you consider in making tha hiring decision? 

Very important 2 Moderately important. Of little importance 

Unimportant 



3. Would you hire another Foothill graduate for a future job in your organization? 
6 Yes 1 No 



OPEN-END QUESTIONS 



What, in your opinion, is the major strength of the occupational training I 
provided by Foothill College?* / 

}. Majority of employers felt Foothill has a worthwhile program--students 
get thorough knowledge of basics. 

2. Graduates seem to have confidence in their work- 

3. One employer commented that there were few good sources of electronics 
training in the area, and that Foothill offered a broad range of information 

*Many employers could not answer this question because they were not familiar with 
our Electronics program. 



What, in your opinion, is the greatest need for improvement in the occupational 
training provided by Foothill College:^ 

1 . More emphasis on: 

a) computor architecture 

b) micro-processors 

2. There is a need to improve/update the equipment, books, and teaching, 
methods. 

3. Emphasize use of test equipment, (i.e., more lab work & courses in 
— micro-wa ve ) . 

4. Areas mentioned that need improvement: 

a) T-square logic 

b) update the state of the Art 

c) be more thorough in teaching the students about integrated 
circuits 



EKLC 
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Electronics 



III-B 



2. Several employers expressed interest in talking with instructors about the 
curriculum. 

3. Additional evening courses. 



M'se employers felt they did not know enough about our training program and/or 
whe student*s knowledge prior to employment and did not answer the above 
Open-End Questions. 

There was a genera^^ that the applicants with college level electronics 

made little or n^^^^^ in the hiring decision. This is because all 

new employees start at an apprentice level. 
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ORNAMENTAL HORTICETURE PROGRAM 
TABUUTION OF DATA 



Job(s) titles: Assistant gardners/nurseryre . 
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Total 



65'/ 4'/ 317. 10/! 337. 



Ornamental Horticulture 



III-C 



1. How would you rate the effectiveness of Foothill's programs in preparing 
individuals for pre-employment procedures? (i.e., interview, application, 
appearance). I 

» 

. 3 Excellent Good ' ;;;^_^Acceptable Below Expectations 

Poor Not applicable 

2. How would you rate the effectiveness of Foothill's programs in orienting 
individuals to employment? (i.e., work attitude, attendance, cooperation 
with co-workers & management). 

4 Excellent Good Acceptable Below Expectations 

^ Poor Not applicable 



How important is Foothill's Ornamental Horticulture training in relation to other 
qualifications you consider in making the hiring decision? 

4 Very important 1 Moderately important _J_ Of little importance 

Unimportant 



4. Would you hire another of Foothill's graduates for a future job in your 
organization? 

5 Yes No 1 Maybe 



OPEN-END QUESTIONS 

What, in your opinion, is the major strength of the Ornamental Horticulture 
training provided by Foothill College? 

1. Students he ve a broad knowledge of the field and are very confident 
wh_en they graduate. 

2. Employers noted that the students also had some business background, 
and- were very attentive and followed directions well. 

3. Over-all knowledge of equipment very good. 

What, in your opinion, is the greatest need for improvement in the Ornamental 
Horticulture training provided by Foothill College? 

1. There is no specialized training; students only employable as nurserymen. 

2. Materials need to be updated (i.e., chemicals ahd-vhow to apply them). 

3. Because of problem #1, the employers feel they have\to spend too much 
time training students. \ / 
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Ornamental Horticulture III-C 



4. The majority of students are looking for higher than entry-level positions, 
but do not have sufficient training. 

5. Stronger emphasis on marketinj^dvertisirsg. 



hat additional comments or suggestions do you have for Foothill College's Ornamental' 
drticulture training programs? 

\. Add a "safety course" to the landscape itiaintenance program, (i.e., operating 
equipment, use of pesticides). 

2. Majority of employers feel students cannot get sufficient training/experience 
in just two years. 
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DE ANZA COLLEGE'S 
PHOTOGRAPHY PROGRAM 
TABUUTION OF DATA 



The jobs to which this tabulation of date applies ra nge s from sales/photographers to dark room assistant. 
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- Phntngraphyii^ 



III-D 



2. 



How would you rate? the effectiveness of our program in prepraing individuals 
for pre-emploi'Tsent proceojres? (i.e., interview, application, personal 
preparation) . 



Excellent 2 Good Acceptable 1 Below Expectations 



Poor 



Not applicable 



3* How important is DeAnza's photography training in relation to other 
qualifications you consider in making the hiring decision? 

Very important Moderately important _L 0^ little importance 

1 Unimportant 

> 

4. Would you hire one of De Anza's graduates for a future job in your organization? 
4 Yes No 3 Mayoe 



OPEN-END QUESTIONS 

What, in your opinion, is the major strength of the Photography program provided 
by De Anza College? ^ 



1. Over-all training is very good. 

2. The program is successful as far as quantity and interest of students'. 

3. Thorough in teaching the basic technique of printing; the color lab is 
very good. 

What, in your bpiriion, is the'gre^a^^^^^ 
program provided by De Anza College? 

1. Students work too slowly in the dark room and do not turn out good prints 
within a short time period. 

2. Students should know the day-to-day routine of photographers in various fields. 

3 "Today we're in the canned-era" — very few young photographers have actually 
prepared tools from scratch, and have difficulties correcting problems that 
arise while printing. 
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Photography 



TII-D 



4. There is a need for better equipirient. (i.e. in the dark room) With 
updated equipment, the students would be more employable. It was 
mentioned that our training was geared for employment only for portrait 
studio positions. Creativity is not as important as competence in the 
technology world. 

Need to emphasize more on: . 

a) industry theory of the film processing 

b) optical system in camera « ^ 

c) working with negatives and different sizes/kinds of film 

d) students need more knowledge of business and advertising --possibly 
business administration, marketing, accounting. 



What additional comments or suggestions do you have for Oe Anza College's 
Photography program? 

1. More off-campus work in the technical field. 

2. Several employers suggested meeting with the instructors of the program 
to plan seminars or field trips to let students become familiar with the 
day-to-day routine 
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Physical Therapy 



Job Title: Physical Therapy Assistant 



1. 25% General hospital 

2. 8%Rehab. Facility 

3. 3 7%Private practice 



4. 
5. 
6. 
7. 



25%ECF 



17%0ut~patient clinic 

Pediatric facility 

8% Other Orthopedic & CVA 



PTA RECEIVES FORMAL EVALUATION EVERY: 



1. 
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2. 42 %6 months 

3. 28%. annually 



4. 
5. 



_l_5%never 
15%0ther 



PTA^'EVALUATION GIVEN BY: 



1, 
2. 



70%Chief RPT 



10%Sertior RPT 



3. 
4. 



10%Staff RPT 



10%0ther 



NATURE OF SUPERVISION: 



On premise 

Phone 

Written 



DAILY 
78% 



11% 



r 



WEEKLY 
11% 



How would you rate the overall effectiveness 
of the technical training provided by De Anza 
College? 



How would you rate the effectiveness of De Anza's 
programs in orienting individuals to employment? 

How would you rate the effectiveness of De Anza's 
programs in preparing individuals for prp-employment 
procedures? 

Overall totals 
% of Excellent & Good 
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10 



12 



= 92% 
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DE A;.;ZA college 
FHISICAL THEltAPIST ASSISrA:,'! ?mm 

TABOLAIiCN OF DATA 
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Physical Therapy 



Table ITI-E 
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Physical Therapy 
OPEN-END QUESTIONS 

What, in your opinion, is the major strength of the Physical Therapist 
Assistant program provided by De Anza College? 

1. The choice of students selected is quite good. Students are 
interested in PT, and perforin well on tl;ie job. 

2. Clinical training is excellent and thorough. This saves 
the employer time. 

3. By identifying the goals of a treatment program they are able to 
assess the patient's progress in relation to his/her total 
program and do not limit themselves to specific treatment. 

4. Well prepared in sciences which provide rationales for practice. 



What, in your opinion, is the greatest need for improvement in the Physical 
Therapist Assistant program provided by De Anza College? 

1. More emphasis on evaluation and measurement (goniometer) 

2. Writing skills. Often times the students leave out '^how much 
assistance was needed" or "how far did the patients walk". 

3. PNF exercises. The PTA's spend 80% of their time with patients doing 
exercises or gait training. The use of PNF exercises is very 
essential and not difficult. 

A. The majority of the PTA's are not strong enough to give an effective 
massage . 

5. More orientation to the specific treatments used in rehabilitation 
setting . - — ' 

6. Students must have professional attitude. 

7. A greater knowledge of pathology, (i.e., what conditions to expect 
with a particular diagnosis) Graduates seem to know little of this. 

What additional comments or suggestions do ^ ou have for De Anza College's 
Physical Therapist Assistant Program? 

1. Students need further, instruction on patient handling and transfer 
techniques. They also need to be aware of v/hich side of a stroke pat 
they should stand next to when walking. 

2. More emphasis on exercise programs. 

3. Besides professional manner, students should dress professionally. 

4. Tighter screening of clinical settings that you utilize for student 
experiences . 
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III-E 
Physical Therapy 



How impottant is college occupational training at De Anza in relation to 
other qualifications you consider in making the hiring decision? 

5 Very important 1 Of little importance 
2 Moderately important Unimportant 



Do you plan to continue employing PTA's? Yes No 

Would you hire another De Anza graduate 

for a future job in your organization? 8 Yes No 
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ANALYSIS 

1 . Approach 

"Findiupg/' can be divided into two categories: (a) those related to 
procedures and (b) those related to questionnaire responses. In neither 
cuse does the data warrant a sophisticated analysis. As stated in the 
Test Plan, the objective was to "design'* and field test a system for obtain- 
ing employer feedback on effectiveness of occupational education and train- 
: ing programs and to incorporate this iiiformation with ongoing program re- 
view and modification processes. " Once a workable system is designed, 
meaningful input data can be obtained. 

The approach consisted of having two members from the District Office of 
Technical Education meet with the instructional deans on each campus to re- 
view the purpose and nature of the study, determine the programs to be sur- 
veyed and secure approval for meeting with program heads and faculty. 
Subsequently, the SAM Consortium-developed sample was reviewed with faculty 
arid district representatives, and faculty jointly agreed on contact methods and 
specific questionnaire items. As a result of these meetings, specialized ques- 
tionnaires were constructisd for each program. 

Table I reveals that disparities between the method for contacting the 
employers as stated in the plan and the method actually used or "executed" 
f occurred in four of ^he five programs; Auto Technology, Electronics, Photog- 

raphy and Ornamental Horticulture. Reasons for this variance follow: 

The Plan called for some combination of up to five different "methods" of 
contacting these employers. The various "methods," i^^ turn, included four 
means of communicating with employers: (1) letter (2) questionnaire (3) 
telephone, and (4) personal interview. The various combinations of these 
means are detailed under the "methods" heading in Table. L 
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Unplanned time consumed in identifying employers (see Findings and 
Results'' (Item 3) and project deadline that remained constant resulted 
in a compressed response period* In order to compensate for this 
condition, it was assumed that a phone call to an employer prior to 
his/her receipt of a questionnaire would generally tend to assure earlier 
returns and, more specifically, would permit immediate identification of the 
current supervisor. It would also provide immediate feedback should the 
former student no longer be an employee of a given company or agency. 
As seen in Table I, this method was added to the pre-servlce Automotive 
Technology and Ornamental Horticulture programs. Following the same 
logic. Item 6, ''Telephone Interview Only" was added to both pre-servlce 
and inservlce Automotive Technology and to Electronics and Photography 
programs. 

An employer follow-up of practicing auto mecha^rics was also undertaken 
though unplanned. This came about in meetings with staff for questionnaire 
development purposes. The staff expressed no less concern for follow-up 
of their continuing education "product" than their day pre-service students. 
Staff also believes that training effectiveness could be detected by the super- 
visor at some point near or upon completion of the concentrated course (six 
hours per week for nine weeks) or "Clinic. " As a consequence, "Clinics" 
were added to the study and a special employer questionnaire was constructed 
for this groui (see Exhibit II, A-2). 

Interpretation 

The displays of collected data and information (Table II) are self-evident and 
required no specific interpretation. Furtlier, the posity of program-related 
data collected in the Pilot Test was insufficient to warrant statistical analysis. 
On the other hand, it did appear that the method used for tabulating and the 
format used for displaying the data were satisfactory, will accommodate re- 
sults of a full study and will lend themselves to reproduction and use by a 
variety of interested individuals. 
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As is the case in most survey reiaeax-ch, certain unexpected by-products 
occurred* Of interest In this study were employer responses not antici- 
pated. Included among these responses were (1) some employers expressed 
appreciation for the opportunity to be contacted (2) some asked to. have 
WEXED students referred to them and, not unexpectedly, (3) most were 
interested in obtatntng copys of the results. 

ACTION 

Dissemination 

Parallel to the handling of "analysis of findings,'' dissemination will vary 
somewhat between the procedural and the program aspects of the study. 
Both procedural and program aspects will, of course, be made available 
to the Field Test Consortium and Project vSAM Employer Follow-up 
Advisory Committee. On the local level, details relating to procedures 
will have a more limited distribution. These findings will be presented 
to the District Technical Education Council (three Deans from each col- 
lege and the District Director of Technical Education), to the division 
chairpersons and faculty of each program engaged in the current study 
and to future faculties as their programs are considered for employer 
follow-up. The purpose, of course, is to share insights gained from 
first-hand experience with the alternatives before deciding on an accept- 
able contact method for any given program. 

Copies of this report will be disseminated to and reviewed by the District- 
wide Technical Education^oimcil, appropriate division chairpersons, 
program heads £orl instructors. All advisory committees are aware of 
this pilot study. Findings will be made available to appropriate program 
advisory committee members and become an agenda item for their consid- 
eration at the next scheduled committee meeting. 

Impact on College Programs 

Impact, tn terms of planned and actual modification of programs, cannot be 
determined prior to advisory committee consideration. Following their input, 
staff will make recommendations which, in turn, will be acted upon according 
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Conclusions and Recommendations 
i for the Design of Future Employer Follow-up Activities 

••«t * 

!• Unless—and until — needed data for identifying employers and obtaining the 

''license" to contact them is greatly simplified, future surveys of employers 

on any regular, systematic basis must necessarily be extremely limited. 

It is reconmiended that no more tiian a dozen programs be added to the list 
to be surveyed in any given year. Thus a five-year period would be required 
to activate employer follow-up for all of the approximately sixty unduplicated 
programs offered within this District. 

It is further recommended that all appropriate staff be involved in devising 
and implenienting a plan that will assure student response to the SAM survey 
at no less than the 75% level. and, if employed, identification of the employer/ 
supervisor of at least an 80% level. 

It is also recommended that a master plan be developed for prioritizing programs 
to be involved in the employer model and such special measures taken as will 
assure that students completing the programs to be surveyed understand the 
importance of and cooperate with the student survey endeavor. Examples of 
criteria that should be considered for continuing and/or adding programs to the 
Employer Model are: 

(a) Faculty has carried out independent employer follow-up on an aimiial 
basis. District OTE could cooperate and provide an ongoing service 
function. 

(b) Current Field Test data ( though inadequate) indicates sufficient 
employer dissatisfaction to warrant a more complete studj* . 

(c) Advisory committees and staff perceive a need for major program 
revision. 

(d) New programs having first ''comple tors'' in the world of work. 

(e) Programs having marginal enrollments. 

(f) Lo %v Placetnents. 

2. The validity of data gathered from employers varies directly with the degree of 
comprehensiveness of the representative sample of employers surveyed. There- 
Q fore, any procedure that reduces the potential universe of employers reduces the 
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validity of the study. Mandating student permission to contact his/her employer/ 
supervisor reduces the employer universe in two ways: (a) if the student does 
not respond to the appropriate question on the SAM student survey or (b) if the 
student's response is ''no'' that employer may not be contacted and, of course, 
the "universe" is reduced. 

It is recommended that local and state staff and committees restudy the necessity 
for obtaining student permission to contact an emjjloyer and seek ways and means 
for removing this barrier to maximum employer participation. 

In order to obtain optimum results for program improvemeiit purposes, question- 
naires must be specifically tailored to the program and occupation(s) for which 
it prepares. Staff assistance in this endeavor and their insights into the character- 
istics of the typical employer and work situation are most helpful in determining the 
contact method to be employed. 

The practice of securing staff (a) particiy>a(voG cc^:::;tructing questionnaires which 
are directly related to individual programs and ih) isistance in obtaining optimum 
employer response should be continued. TJ^^fx in tWi/ urograms. Photography and 
Electronics, are of the opinion that the tiir.-:: 1u[;dc etween leaving a program and 
conducting follow-studies with employers s::.c::M not be attempted before two or 
three years on the job. Tt^ere exists the possibility that in some wv^rk situations a 
time span of this duration is requfT; jd for a variety of job experieace? lilrh will 
reveal ^/lo* range of cognitive kinds of skills which tie former st^^ josse.=?s. 

It is recommended that steps be taken to test the hyi)otheses chr t a longer time 
span (e*[^.< two to three years) would yield more positive data un training 
effe '.ivennss. 

Slafy ;;enerany approved of the "essential" verses "non- essential" ratings for a 
list of p< cnntfal job skills. Some employer respondent- for some skills, found 
this "eit}*c»r-or" choice too extreme. 

It is recommended that future questionnaires employing this format insert a "useful" 
O'.iumn heading between the two extremes. 



Questionnaires sent to supervisors in large businosaes and industries seemed 
frequently to not reach tiie person for whom the. questionnaire was intended. 

It is recommended that District and/or College 'raff meet with business and 
industry personnel department representatives, '<:xplain the purpose of the survey 
and attempt to secure their cooperation by seadin^.- questionnaires to the depart- 
ment which, in turn, will be delivered to thi^ appropriate sup^ /-visor. 

Much clerical time was consumed going thy ovij^h complete, ' Omputer-printed, 
alphabetical listings of vocational education studer^s aivJ mv^nually listing com- 
pleters of programs being surveyed. 

It is recoir5;riended that future computer print-outs of SAM occupational stijidents 
be available on a program rather than a straight alplia listing basis. 

Program advisory committees, at best e :i relatively small and, perhaps for 
good and sufficient reason, not a statidric<i;iy sound random sample of the range 
of employers and occupations they repic^ent. The addition of the employer com- 
ponent to SAM has the potential for broadening the data base, for program planning, 
revision and evaluation purposes. 

It is recommended that the results each program surveyed be reviewed by 
appropriate staff, made available to the program rdvisory committee members and 
utilized 'rS an additional source of inforrr.ation available to the committee for pro- 
gram advisement purposes. 

It is the judgement of the project's data specialist that the telephone proved to be 
an efficient, effective and satisfactory information gathering tool. An exception 
appeared in the automotive trades. It is conceivable that relatively (a) heavy work 
pressiires, (b) relatively high labor charges and (c) standardized repair rates, and 
quota:^ tended to discourage telephone discourse. 

It is recommended that the current use of the questionnaire coupled with various 
telephone alternatives be continued in future surveys, thtxt special attention be 
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given to kinds of job situations likely to be encountered and, if generally accept- 
able methods are unpvodcotlve, staff should be prepared to experiment with other 
methods including, tii(ft pi^r sonal interview. 

While admittedly not statistically significant, as a result of constraints previously 
mentioned, there is some evidence that employer input differed markedly from 
information revealed in advisory committee minutes. 

It is recommended that advisory committee minutes be reviewed and that any 
wide disparities between inputs from advisory committee members and those from 
employer responses be analyzed in terms of job performance requirements by con- 
ducting formal surveys and by examining the composition of advisory committees. 

Employer follow-up is an involved, arduous task but is judged to be a desirable 
and practical means of helping build the data base needed for comprehensive pro- 
gram planning and evaluation purposes. 

It is almost axiomatic that time is a factor that must be considered seriously in 
attempting siH^veys of this nature (see Exhibit "G"). Even assuming sufficient and 
satisfactory student-provided employer information on a dozen new programs, a 
period of approximately three months should be allowed in order to carry out the 
activities outlined in this study. Assuming that employer follow-up surveys are 
part of the professional responsibilities of occupational instructors and administra- 
""fof s, the persorinel requirement for applying the system to ten to twelve programs 
and involving 500 employers will approximate one '^man-month'' for clerical and 
support kinds of services. Assuming a cost for clerinal assistance and materials 
of $1,000, the cost of employer return would amoimt to $2. 00. 

It is reconmi ended that employer foliow-up become an annual, on^; . ;u;.. activity and 
this activity continue to be a cooperative venture on the part of the District Office 
of Technical Education, College administrators and occupational education faculty 
with the District conducting the survey as one of its service functions. Priorities 
of the District Office should be established in a manner that will permit the inclu- 
sion of this function without an increase in existing staff. 
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Exhibit A-1 

FOOTHILL 
COMMUNITY 
COLLEGE 
DISTRICT 

DE ANZA & 
FOOTHILL COLLEGES 

12345 El Monte Road 
Los Altos Hills 
California 94022 
(415)948-3523 



What^s this? 

A questionnaire which you need not fill out. We do, however, need your 
cooperation when I or a representative from my office phones you sometime 
in thi next few days . 

Why me? 

Because our records show that you are the emp loyer /super vis o^^ of at least 
one person who completed all or a significant portion of bur Automobile 
Technology education and training program. Only you are in a position to 
judge the adequacy of this program in terms of job entry skill requirements. 

So what? 

Occupational Education is expensive — to the student and taxpayer alike — we 
can't afford to be wrong. The information you provide will be used to assure 
that futcire students will get the training you, our employers, need. 

Remember, it's the program we want evaluated — not our former student. 

You'll be hearing from us . Thanks in advance for your cooperation. 

Sincerely, 



Les Schwoob 

Director of Automotive Technology 



mk 

Enclosure 
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EMPLOYER'S EVALUATION OF THE AUTOMOTIVE 
TECHNOLOGY PROGRAM AT DE ANZA COLLEGE 



Exhibit A-! 



The job title(s) to which this evaluation applies is: 



1. Please evaluate the overall effectiveness of the De Anza Automotive Technology 
program by checking whether the job skill items are "Essential" or "Non-essential" 
to the above job in your organization and your rating of De Anza*s effectiveness 
in training for those items. 



^ - ^ . JOB $KILL3 ITEMS _1 

a. Technical Knowledge 

b. Operation of Equipment 

c. Writing skills ^ 

d. Verbal Communications \ 

e. Computational Skills 

f. Pre-employment procedures (application, [ 

interview, personal appearance) 
q. Orienting individuals to employment 

(punctual Ity, at tendance, attitude) 
h. Others (specify) 



2. How important is formal Automotive training in relation to other qualif icatior 
you consider in making the hiring decision? 

Very important Of little importance 

Moderately important Unimportant 



3, Would you hire another De Anza Automotive Technology graduate for a future 
job in your organization? 
Yes ^0 

OPEN-END QUESTIO NS (Use reverse side if additional space is required) 

What, in your opinion, is the major strength of the Automotive Technology 
training provided by De Anza College? 

What, in your opinion, is the greatest need for Improvement in the Automotive 
Technology training provided by De Anza College? 



What additional comments or suggestions do you have for De Anza College's 
Automotive Technology training programs? 



Please send me a copy of the completed survey. 

oo t J 



Exhibit B 



Dea r : 

Staff responsible for the Auto Clinics at De Anza College need your input in order to determine 
the effectiveness of the training provided. 

We get feedback from practicing mechanics in these clinics but employer ratings are lacking. 

Please take a few minutes to reply to the following questions. The information you provide 
will help us do a better training job for you. 

Sincerely yours, 



Les Schwoob, Executive Head 
Automotive Technology Program 



^ I' ^ 



JOB SKILL ITEMS 



1, Do the clinics improve the confidence level of a mechanic? 



/ / / 



2. Do the clinics improve a mechanic's ability to analyze problems? 

3. Do the clinics improve a mechanic's ability to take proper steps 

for correcting a problem? 

4. Do the clinic^ broaden a mechanic's abilities? 

OPEN-ENDED QUESTIONS (Ilse reverse side if more space is needed) 

What, in your opinion, is the major strength of the Automotive Technology training provided by 
De Anza College? 



What, in your opinion, is ,he greatest need for improvement in the Automotive Technology train- 
ing program provided by De Anza College? 



What additional conin^onts or suggestions do you have for De Anza College's Automotive Tech- 
nology Prograni? 



ERLC 
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Exhibit C-1 

FOOTHILL 
COMMUNITY 
COLLEGE 
DISTRICT 

DE ANZA & 
FOOTHILL COLLEGES 

12345 El Monte Road 
Los Altos Hills 
California 94023 ~ 
(415) 948-3623 



What's this? 

A questionnaire which you need not fill out. We do , however, need your 
cooperation when I or a representative from my office phones you sometime in 
the next few days . 

Why me? 

Because our records show that you are the employer /supervisor of at least one 
person who completed all or a significant portion of our Electronics education 
and training program. Only you are in a position to judge the adequacy 
of this program in terms of job entry skill requirements . 

So what? 

Occupational Education is expensive — to the student and taxpayer alike--we can't 
afford to be wrong. The information you provide will be used to assure that 
future students will get the training you, our employers, need. 

Remember, it's the program we want evaluated — not our former student. 

You'll be hesiring from us. Thanks in advance for your cooperation. 

Sincerely , 



Paul L. Evans 
Electronics 



mk 

Enclosure 
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EMPLOYER'S EVALUATION OF ELECTRONICS Exhibit C-2 

PROGRAMS AT FOOTHILL COLLEGE 

The job title(s) to which this evaluation applies is: . 



1. Please evaluate the overall effectiveness of the Foothill electromcs train- 
ing program by checking whether the job skill items are "Essential" or "Non- 
essential" to the above job in your organization and your rating of Foothill's 
effectiveness in training for those items. 

^ ^ JOB SKILLS ITEMS ^ ^ ^ 

a. Technical knowledge of electron, theory 

b. Operation of equipment & instruments _2 

c. Writing skills 

. d. Verbal communications ' ~ 

- e. Computational skills 

f. Pre-employment procedures (application, 

interview, personal appearance) 

g. Orienting individuals to employment 

(punctual ityjattendance^attitude) . 

h. Others (specify) 



2. How important is college level electronics training in relation to other 
qualifications you consider in making the hiring decision? 

^Very important ' Of little ijnportance 

Moderately important Unimportant 

3. Would you hire another Foothill graduate for a future job in your organization? 

Yes No 



OPEN-END QUEnONS (Use reverse side if additional space is required) 

What, in your opinion, is the major strength of the occupat^'onal training provided 
by Foothill College? 



What, in your opinion, is tne ^jjeatest need for improvement in the occupation, 
training provided by Foothill uolloge? 



What additional comments or suggestions do you have for Foothill Collegers occup- 
ational training programs? 



^Please send me a copy of the conipleted survey. 
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Exhibit D-1 




FOOTHILL 
COMMUNITY 
COLLEGE 
DISTRICT 

OE ANZA & 
FOOTHILL COLLEGES 

12345 El Monte Road 
Los Altos H tis 
California 94022 
(415) 946-3523 



De Anza College's Physical Therapist Assistant program is conducting student 
and employer follow-up studies to determine the quality of job preparation our 
college provides . Feed-back information will assist in our curriculum revision 
and development process . 

According to our records STUDENT'S NAME is currently. employed by your 
organization. Your input is vital in that it gives us the employer's point of 
view. In responding to the questionnaire please remember it's the program, 
NOT the student that's being evaluated. However, if confidentiality is a 
concern you should know that we have signed releases from our graduates which 
allows us tr obtain this kind of infarmcttion. 

Will you kindly take a few minutes today to complete and return the questionnaire. 
A stamped envelope is enclosed for your convenience. 
Thank you for your cooperation. 

Sincerely , 



Frances A. Lupi 
Physical Therapy 



Enclosure 
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Exhibit D-2 



FACILITY NAME 
ADDRESS 



OE ANZA COLLEGE 
PHYSICAL THERAPIST ASSISTANT PROGRAM 

DATE COMPLETElj 



Please check correct response unless otherwise indicated. 

4. ^ECF 

5. Out-patient clinic 

6. 



1. 
2. 
3. 
7. 



General hospital 
Rehab, facility 
Private practice 



Pediatric facility 



Other (specify) 



JOB DUTIES OF PTA: > 

Please indicate time spent weekly \v placing number indicating appropriate 
percentage range in blanks preceding listed duties. 



Duties 

_Patient care 
_Preparation & clean up 
•Clerical 

_Conferences/me3ti ngs 
_In-service 

student affiliation programs 

(RPT & PTA) 
Other (specify) 



PTA RECEIVES FORMAL EVALUATION EVERY 

1 . ^3 months 

2. 6 months 
3. 



yearly 



PTA EVALUATION GIVEN BY: 

1. ^Chief RPT 

2; Senior RPT 



Percentages 

1. 0-10% 

2. 11-20% 

3. 21-30% 

4. 31-40% 

5. 41-50% 

6. 51-60% 

7. 61-70% 

8. 71-80% 

9. 81-90% 
10. 91-100% 



4. never 

5. Other (specify) 



3. Staff RPT 

4. Other (indicate) 



NATURE OF SUPERVISION: 
Check appropriate column. 

1 . On premise 

2. Phone 

3. Written 

4. Other (explain & 

indicate frequency) 



DAILY 



WEEKLY 
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How would you rate the effectiveness of De Anza College in training for each of 
the following areas? Space has been provided ^ir you to rate training in specific 
skills that are essential for your facility. . 



COGNITIVE SKILLS 

a. Anatomy 

b. , Physiology 

c. Kinesiology 

d. Pathol ogicati processes 

e. Indications & contraindic. 

COMMUNICATIVE SKILLS 

f. Verbal 

g. Written 

h. Judgemental 

i. Medical terminology 

TREATMENT SKILLS 

j. Modalities 

k. 'Exercise 

1 . Ambulation 

m. Functional activities 

n. Pat-icr.L prep & evaluation 

0. Assistance with evaluation 
and complex Rx procedures 




TECHNICAL SKILLS 

How would you rate the overall effective- 
ness of the technical training provided 
by De Anza college? 

How would you rate the effectiveness 
of De Anza's programs in orienting indi- 
viduals to employment? (i.e., work attitude, 
attendance, cooperation with co-workers & 
management) . 

How would you rate the effectiveness of 
De Anza's programs in preparing individuals 
for pre-emp' oyment procedures? (i.e., the 
interview, application^ personal present- 
ation). 



85 
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How important is college occupational training at De Anza in relation to 
other qualifications you consider in maKing the hiring decision? 

1. Very important 3. Of little importance 

2. Moderately important 4. Unimportant 



Do you plan to continue employing PTA's? Yes No 

Would you hire another De Anza graduate 

for a future job in your organization? Yes No 

If not, please explain. ' 



OPEN-END QUESTIONS (Use reverse side if additional space is required) 

What, in your opinion, is the major strength of the Physical Therapist Assistant 
Program provided by De Anza College? 



What, iri-yo.ur-opinion', is the greatest need for improvement in the Physical 
Therapist Assistant Program provided by De Anza College? 



What additional comments or suggestions do you have for De Anza College's 
Physical Therapist Assistant Program? 



^Please send me a copy of the completed survey- 
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Exhibit E-1 




FOOTHILL 
COMMUNITY 
COLLEGE 
DISTRICT 

DE ANZA & 
FOOTHILL COLLEGES 

12345 El Monte Road 
Los Altos Hills 
California 94022 
(41S) 940-3523 - 



What's this? 

A questionnaire which you need not fill out. We do, however, need your 
cooperation. when I or a representative from my office phones you sometime 
in the next few days . 

Why me? 

Because our records show that you are the employer/supervisor of at least one 
person who completed all or a significant portion of our Photography education 
and training program. Only you are in a position to judge the adequacy of 
t\ program in terms of job entry skill requirements. 

So what? 

Occupational Education is expensive — to the student and taxpayer alike — we 
can't afford to Le wrong. The information you provide will be used to assure 
that future students will get the training you, our employers , need. 

Remember, it's the program we want evaluated — not our former studer t. 

You'll be hearing from us. Thanks in advance for your cooperation. 

Sincerely, 



George Cra^.^en 
Photography 

mk 

Enclosure ' \ 
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hMKLUYtK'S EVALUATION OF PHOTOGRAPHY Fvhihif 17-2 

PROGRAM AT DE ANZA COLLEGE J^-xdidu 



ERIC 



The job title(s) to which this evaluation applies is 



1. riow wuuld you rate the effectiveness of De Anza College in training for each of 
the following areas. Space has been provided for you to rate training in specif f*.. 
skills that are essential for your facil ity. 



^ JOB SKILL ITEMS ^ ^" 



a. General operation of equipment 

b. Skill in visualizing irnc' /^^/cictures 

c. Gen. knowledge of black ^- . -ite pro- 
cesses 

d. General knowledge of color pr .^^ses 

e. Verbal Communications 

f. Problem solving ability 

g. Knowledge of cinema productior* s'si;"!^ 

h. Knowledge of cinema laboratory' i-.eoh- 
niques 

i. Other 



2, How would you rate the effectiveness of our pro- 
gram in preparing individuals for pre-employment 
procedures? (i.e., the interview^ application, 
personal preparation) 



3. How important is De Anza's photography training in relation to other qualifica- 
tions you consider in making the hiring dev;ision? 

Very important Of little "importance 

M oderately important _'_Unimportarit 

4. Would you hire one De Anz^'s graduates for a future job in your oryanization? 

^Yes 'i if not, please explain. 

OPEiJ EiJC QUESTIONS (.ro- additioial space use revers side) 

What, in your opinion, is the major strength of the Photography program provided 
by De Anza College? 



What, in your opinion, is the greatest need for improvement in the Phoi:ogr:ip;,y pro- 
gram provided by De Anza College? 



What additional comments or suggestions do you have for De Anza College's 
Photography programs? 



__Pleose send me a copy of the completed survey. 
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.Exhibit F-1 

-^ri FOOTHILL 

jb*I community 

f^nn COLLEGE 
-^-^^ DISTRICT 




DE ANZA & 
FOOTHILL COLLEGES 

l2345Ei Monte Road 
Los Altos Hills 
California 94022 
f4l5}94B>3523 



What's this? 

A questionnaire which you need not fill out. We do , hov ever , need your 
cooperation when I or a representative from my office phones you sometime 
in the next few days . 

Why me? 

Because our records show that you at e the niployv^r /supervisor of at least cue 
person who completed all or a significant pj.rtion oi our Ornr^inental Horticulture 
education and training program. Only you ave in a position to judge the adequacy 
of this program in terms of job entry skill requiremerts . 

So what? 

Occupational Educatior is expensive — to the .Ouder.. and taxpayer alike- we can't 
afford to be wrong. The information you provide will be used to assure tnat 
future students will get the training you, our employers . need. 

Remember , it's the program w£ want evaluated- -n* ;: o ir former student. 

You'll be hearing from us . Thanks in advance for your cooperation. 

' Sincerely , 

William R. Patterson 

Coordinator, Ornamental Hortir.u^^ure 

mk 

Enclosure • ' "* 



89 

43 



EMPLOYER'S EVALUATION OF FOOTHILL COLLEGE'S ^ o 

ORNAMENTAL HORTICULTURE PROGRAM ExhiDit F-2 

Please specify job title(s) to which this information applies. . 

TECHNICAL SKILLS 

P^iease identify wMch of the following are "Essential" or "Non-essential" to this job 
in your organization. How would you rate the effectiveness of Foothill College's 
training for each of these skills. Space has been provided for you to check and rate 
training in specific skills essential for the job. 



JOB SKILL ITEHS ^° -^^"^ ^° 

a. Operation of Equipment 

b. Writing Skills [ 

c. Verbal Communication 

d. Computation Skills 

e. Knowledge of Plant Materials 

f. Knowledge of Construction 

g. Knowledge of Plant Desease & Pests 

• h. Knowledge of Design 

i. Knowledge of Irrigation Systems 

j. Other 



1. How would you rate the effectivenes*s of Foothill's 
programs in preparing individuals for pre-employment pro- 
cedures? (i.e., interview, application, appearance). 

2. How would you rate the effectiveness of Foothill's 
programs in orienting individuals to employment? ^i .e. , 
work attitude, attendance, cooperation with co-workers & 

management). 

3. How important is Foothill's Ornamental Horticulture training in relation to other 
qualifications you consider in making the hiring decision? 

^Very important Of little importance 

Moderately important Unimportant 



4. Would you hire another of Foothill's graduates for a future job in your organization?- 
^Yes ^No 

OPEN-END QUESTIONS (Use reverse side if additional space is required) 

What, in your opinion, is the major strength of the Ornamental Horticulture training 
provided by Foothill College? 

What, in your opinion, is the greatest need for improvement in the Ornamental Horticulture 
training provided by Foothill College? 

What additional comments or suggestions do you have for Foothill College's Ornamental 
Horticulture trajning programs? 



^ ^Please send me a copy of the completed survey. 
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FOOTHILL-DE ANZA COMMUNITY COLLEGE DISTRICT 
Office of Technics* I Education 

SAM Follow-up rime Schedule 



MARCH 



APRIL 



MAY 



ACTIVITY 



Plan with OTE Staff 



Plan with College Deans 



Organize Existing Data 



Field Test Plant 



riudget 



Questionnaire Copy 



Printing & Mailing 



Data Collection/Tabulation 



Data Analyses 



Action Recommendations 



Final Report 
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SAM EMPLOYER FOLLOW-UP 
FIELD TEST REPORT 
SAN DIEGO COMMUNITY COLLEGE DISTRICT 



Department 
of 

Manpower Training and Vocational Education 



4 



May 25, 1976 



\ — 



San Diego, California 



ERIC 



92 



INTRODUCTION 



Among the more critical aspects of all occupational preparation programs 
are the skills evidenced by the students' transition into new employment. 

In order to develop an indicator of overall instructional effectiveness of 
specific occupational programs, a follow-up study was conducted, utilizing 
employer evaluations of former student job transition as the basic index 
of quality of the program. 

The tv/o occupational programs utilized in this employer follow-up operation, 
Aviation Maintenance Technology and Electronics Technology, represent 
well-established technical education programs at San Diego Miramar, and San 
Diego Mesa Colleges. These programs were selected because they reflect 
rapidly changing technologies and are therefore acutely in need of continual 
feedback from employers and industry, and provided classes Targe enough to 
furnish significant employment feedback. 

RFVIEW OF OBJECTIVES 

1. To establish an indication of overall instructional effectiveness in 
selected occupational programs by conducting an employer follow-up 
study of June 1975 graduates. 

2. To develop a vehicle to facilitate articulation with appropriate p--" ^vers 
to provide needed program/course revisions. 

3. To provide an opportunity for instructional/follow-up personnel to inter- 
act with operational supervisory personnel. 



ERLC 



PRESENTATION OF FINDINGS 

Population - Students selected for the employer follow-up were those 
students identified in the SAM student follow-up system as being em- 
ployed in the occupational field for which they were trained. This 
provided eleven (5G/J) appropriately employed students of a^class of 
22 in Aviation Maintenance Technology, and seven (30%) of a class of 23 
in Electronic Technology. No attempt was made to obtain updated information 
on students who secured appropriate employment after the SAM follow-up was 
completed in November, 1975. 

Design - The method of investigation utilized two steps, including an 
initial phone contact with the student to secure inquiry permission, and 
a phone and personal discussion with appropriate employer personnel. The 
student phone contact generally served well to begin the follow-up process, 
with both home and/or business numbers being used to reach the student. 
The use of a business number was tempered by the type of employment 
involved. 

Employer response to this critical input point was without exception very 
positive , and not only resulted in providing data for the stated objectives 
of the study, but served as a communication vehicle in other areas of 
common interest (see Evaluation of Data). 

Instrument •• The follow-up questionnaires used in the two disciplines were 
similar in format (see Analy'sis of Data) and provided for objective evalua- 
tion of specific job-related activities and operations, as well as space 



for additional subjective comments. The latter provided information 
related to both curriculum specifics and general quality of job 
entrant. 

In administering the que^ t-^onnaires, follow-up personnel made a con- 
certed effort to convey to employers that the information being sought 
was to be reflective of the skills and capabilities brought into the 
job, and evidenced during the transition period. This process was not 
to be a specific job performance evaluation. 

Analysis of Data - A simple mean and mode was calculated for each 
question in the Technical and General Knowledge Areas, based on a number 
value assigned to response columns, with (4) corresponding to "Excellent", 
decreasing to (-1) for a "Poor" rating. 

The results of this analysis are indicated on the accompanying sample 
questionnaires. 
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SAM EMPLOYER FOLLOW-UP STUDY 
QUESTIONNArr<£ 



In order to provide students with the training needed to succeed in the air- 
craft maintenance industry, it is most important that we obtain information 
from operational level personnel as to the adequacy of the present job 
preparation training. program. 

We are, therefore, asking for your evaluation of effectiveness of the train- 
ing brought to the job by these former students' Vie would like to emphasize, 
our request is for information concerning the instructional program, and is 
not a personnel performance report. 

Please rate the following job-related areas as an indication of how v/ell-- 
prepared students were for transition into your operation. 

(4) (3) 



Technical Knowledge Areas 

A. Aircraft Systems Operation 

B. Powerplant Systems Operation 

C- Malfunction Analysis and Applications 

to Troubleshooting 

>. , 

D. Test Equipment Applications 

E. Maintenance and Repair Operations 

a-d Skills 

F. Interpretation and Application of 

Technical Data and Publications 

G. Maintenance Forms and Records; F.A.R.' 
H- Additional Comments: 
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General Knuwledge Areas 



A. 


Computation Skin-: 


[7] 


[3] [ ] 


[1] [ ] 


[ ] 


3. 


7 


B. 


Written Communication Skills 


[d 


[6] [ ] 


[ ] [ ] 


[ ] 


3 


5 


C. 


Verbal Coirouni cation Skills 


[d 


[4] [ ] 


[ ] [ ] 


[ ] 


3 


6 


D. 


Ability to Work with Others 


[9] 


[2] [ ] 


[ ] [ J 


[ ] 


3 


.8 


E. 


Ability to Follow Directions 


[9] 


[2] [ ] 


[ ] [ ] 


[ ] 


3 


.8 


F. 


Exhibits Potential ^oY Continued 
Job Grov^th 


[8] 


[3] [ ] 


[ ] [ ] 


[ ] 


3 


.7 


G. 


Based on Your Experience — 
^ Would You Recommend Hiring Future 
Graduates From Our Program 




Yes 

nu 


No 
[ ] 









H. Additional Comments: 
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SAM EMPLOYER FOLLOW-UP STUDY 
QUESTIONNAIRE 



In order to provide students with the training needed to succeed in the 
electronics industry, it is most important that we obtain information from 
operational level personnel as to the adequacy of the present job prepara- 
tion training program. 

Vie are, therefore, asking for your evaluation of effectiveness of the train- 
ing brought to the Job by these former students. We would like to emphasize, 
our request is for information concerning the instructional program, and is 
not a personnel performance report. 

Please rate tha following job-related areas as an indication of how well- 
prepared students were for transition into your operation. 

(4) (3) (2) (1) ^ (-1) (N/A) 



Technical Knowledge Areas 
A. Basic Circuit Operation 

Circuit Analysis and Application 



C. 
D. 



to Troubleshooting 

Test Equipment Applications 

Maintenance and Repair Operations 
and Skills 

Interpretation and Application of 
Technical Data and Publications 



Additional Comments: 
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2. General Knowledge Areas 



A. 


Computation Skills 


[ ] [3] [4] 


[ ] 


[ ] 


[ ] 


2 


4 


2 


B. 


Written Communication Skills 


[ ] [3] [4] 


[ ] 


[ ] 


[ ] 


2 


Sl 


2 


C. 


Verbal Communication Skills 


[ ] [4] [3] 


[ ] 


[ ] 


[ ] 


2 


6 


3 


D. 


Ability to Work with Others 


[2] [5] [ ] 


[ ] 


[ ] 


[ ] 


3 


3 


3 


E. 


Ability to Follow Directions 


[2] [3] [2] 


[ ] 


[ ] 


C ] 


3 
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3 


F. 


Exhibits Potential for Continued 


















Job Growth 


[1] [3] [2] 


[1] 


[ ] 


[ ] 


2 


.6 


3 



G. Based on Ydur Experience — 
Would You Recommend Hiring Future 
Graduates From Our Program 

H. Additional Comments: 



Yes 
[6] 



No 

[ ] 
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Evaluation of Data - A meaningful statistical evaluation of data was not 
possible, since the student population and sample analyzed was far too 
small to develop any significant statistical information. 

There are, however, some useful generalities that are evident from the 
data. These are proffered for each of the disciplines as follows: 
Aviation Maintenance Technology 

1. Technical Knowledge Areas - Information developed from eleven (11) 
students indicated a very high overall rating of tl^e job-related 
technical knowledge evidenced upon entering employment. 

2. General Knowledge Areas - The overall evaluation of student capa- 
bilities in these areas, although appropriate to most types of em- 
ployment, was about equal to the ratings of the technical areas, 
i.e., quite high. 

3. Based on the overall performance of the student employee, all 
eleven employers would recommend future hiring of program graduates. 

4. Additional Comments 
Technical Knowledge Areas 

a. Outstanding - owner can leave shop for 2-3 days & all work will 
be done & done correctly. 

b. Understanding - outstanding . 

c. Best man they've had from our school. 

d. He is employing people for Solar. They feel that his experience 
in the military & the knowledge obtained at our school has enabl 
him to be successful in his job. 
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General Knowledge Areas 

a. If job is completed he will sweep out hangar, straighten up 
parts bins or anything that needs doing. 

b. Moves -» slow. 

Electronic Technology 

1. Technical Knowledge Areas - Evaluation of very limited data in- 
dicates differing levels of preparation in these job knowledge 
areas. In general, the basic knowledge and skills-related areas 
were rated between acceptable and good, while advanced concepts 
indicated by "Circuit Analysis and . . .Troubleshooting"^' were 
rated somewhat lower. 

2. General Knowledge Areas - Overall ratings reflected acceptable to 
good ratings, with "Ability to Work with Others" rated above the 
other categories. 

3. Responses indicating employer's recommendation for future hiring of 
program graduates reflected six (6) of seven (7) affirmative replies 
The single non-affirmative: response was "no recommendation", rather 
than a negative reply (see Additional Comments). 

4. Additional Comments 
Technical Knowledge Areas 

a. Excellent learner & enjoys electronics. 

b. Student had no knowledge of tube theory & operational amplifiers 

c. Theory of operational amplifiers. Field effect -^ansis:ors. 



d. He seemed more prepared for engineering technology - had 
difficulty accepting that a unit could be built wrong. 

e. In reference to B.t people tend to overlook assembly errors 
when troubleshooting, and expect trouble-free design. 

General Knowledge Areas 

a. Since student is first experience with SDCC graduate, I 

have no basis for comparison and would not make a recommenda- 
tion on one person. 

b. I realize that most students in the program at Mesa are ex- 
mil itery and have some experience, but something should be 
done for those who don't know Ohm's law before they get in 
school. 

c. Seemed to feel he had all the education he^required, and that 
continued study of "State of the Art" technology was unnecessary. 

d. ! would rate Mesa students higher than any other comparable 
school or technical institution in San Diego. 

Information Relating to Objectives - Much dialogue was developed between 
employers/operational supervisory personnel, and follxiw-up personnel. This 
dialogue was without exception very constructive, Infonhation developed 
through these discussions included: r 

1. Recommendations relating to specific course/curj^ulum improvements; 

2. Instructional equipment recommendation; 

3. Possible sources of instructional supplies and equipment; 

4. Requests for future student job referrals; 

5. Development of improved rapport-withy-and-aecess into these instructional 
programs. 

. ioo 



Limitations ■ It is recognized that many significant limitations were 
present In the employer follow-up study. These limitations represent 
formidable constraints in producing a valid educational research method 
and instrument. Limitations include: 

1. An indication of overall student preparation/instructional effective- 
ness cannot be developed from the population available in a single 
class. 

2. Additional follow-i'P peculation could be identified if a post-SAM 
contact were initiated to identify students who obtaine/i appropriate 
employment after the suspense date of the SAM Follow-Up. 

3. Due to the inherent mobility of persons employed in the aviation 
industry, four (4) additional employed students had left this geo- 
graphical area, and were not available to follow-up personnel, although 
appropriately employed. 

4. Many (seven) of the Electronic Tewnnolcgy graduates were pursuing ad- 
vanced electronic education programs at fovrr-year institutions and were 
therefore not included, although active in the technology. 

5. Two additional Electronic Technology graduates were active-duty military 
electronics personnel, but were ADCOP graduates and were no longer in 
the area. 

6. Information developed by follow-up personnel was influenced greatly by 
their related technical and professional skills, and their ability to 
relate to the employer/supervisor needs. 
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SUMMARY AND CONCLUSIONS 

A review of the information developed arc! .f'the Objectives of the Study 
indicates the following: 

1. An employer follow-up study utilizing the methodology described 
herein is of use in developing information concerning student 
transition into a technical employment field. 

2. In order to obtain an accurate reflection of the overall instructional 
program effectiveness, two or more follow-up efforts will be neces- 
sary, possibly involving several classes. 

3. The personal dialogue developed between technical personnel in in- 
dustry and education provides a worthwhile forum to address the needs 
for, and details of, course/curriculum improvements. 

4. Instructional/follow-up personnel gained the opportunity to visit 
companies and operations not previously included in their realm of 
exposure." They were often invited to return in the future. 

< 

RECOMMENDATIONS 

1. Future employer follow-up studies could be very useful in revising 
courses/curriculums in occupational education programs. However, 
these follow-up activities must' be based on information developed 
from more than one class. 

2. Information developed by an employer follow-up will be more effective 
when integrated with other forms of feedback information such as 
advisory committees, technical seminars, field trips, and other 
modes of communications. 
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Employer follow-up studies may be more effective when applied to 
instructional programs that exhibit symptoms of the lack of en- 
rollment, low placement, lack of staff involvement in the field, 
low levels of employer involvement, or programs involving rapidly 
changing technology. 

The efforts required in terms of time, personnel, and resources 
to implement the personal contacts portion of the follow-up 
operation were a very positive force in meeting the objectives of 
study. 

A crucial element in this, or any personal contact-type of employer 
follow-up, is the ability of the follow-up personnel to relate 
technically and professionally to the employer/supervisor operational 
requirements. 

Some occupational programs would not lend themselves to this type of 
follow-up study, especially where production operations, safety, or 
other operational or personnel factors would make personal contact 
unwise. 

Advisory ciinnlttee membership may be updated as a result of increased 
employer communications. 
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SAN JOSE CITY COLLEGE SAM EMPLOYER FOLLOW-UP FIELD TEST PLAN 
iontact person and Field Test Coordinator: Dr. Greg S. Ohanneson, Assistant Dean of 
instruction. Occupational Education. 

i . District and College Information : 

San Jose Community College District, San Jose City College, 2100 Moorpark Avenue, 
San Jose, CA 95128; phone (408) 298-2181 Ext. 282, 

>. Method 

a. College Objective: To collect employer data in sufficient depth to stimulate 
program improvement as indicated. 

b. District and Campus Participants: 

- Dr. Paul Preising, District Director of Grants and Research 

- Mr. Earl Webb, Assistant to the President, Evergreen Valley College 

- Mr. Bill Deem, Electronics Department Chairman, San Jose City College 
c- Activities: 

1. Occupational program involved : Electronics/Laser 

2. Instrument Design : Ohanreson, Deem et al., Preising, Webb 

3. Sampl ing : The total population was polled. Students contacted numbered 
480. ' Employers were contacted following written student permission. 

4. Contact Method : Introductory letter with sample questionnaire, followed 
by telephone calls to obtain the actual survey data (C-1). (See proto- 
type questionnaire ettached.) 

5. Identification of Empl o yers was by means of information previously 
obtained on student survey; project conducted special student survey. 

6. Student-Employer Contact Coordination : Ms. Beatrice Cossey, Consultant, 
directed by Ohanneson. 
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7. Data Analysis : Cossey, Ohanneson 



Findings ond Results 

a. Followup of students enrolled in Electronics classes 

Former San Jose City College students (a total of 480), who were ider.cified as 
having been enrolled in electronics courses during 1974-75, were contacted by - 
mail to obtain follow-up information about the electronics courses taken.' A 
special follow-up form was constructed (see Appendix A) which (1) enabled 
quantification of student responses, and, (2) solicited their signed approval 
to also contact their employer for purposes of an employer follow-up. (See 
appendix B for project time line.) 

i - ' 

Signed employee releases to contact employers were a special condition of this 
particular follow-up study. This condition was based on the opinion of an ad- 
^visory group, which argued that if employers were contacted without obtaining 
'former student/employet releases, the college might be liable for invasion of 
;personal privacy. 
I 

Intensive efforts were made to contact students and to obtain permission to 
contact their employers. Two mailings were made to all 480 students (see Table 
Phone numbers were located for 265 students and all of these numbers were calle 
at least twice. A total of 178 (37%) had no listed or locatable telephone 
number. Of the 265 telephone calls made, 78 (29%) had either moved, had phones 
disconnected, or had given a wrong number. Fifteen personal visits were made 
to various categories of addresses. All visitations were negative 

f 
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The data collected strongly suggest that for this type of survey^ with the 
particular conditions imposed, telephone followup is not a Vt-^ry effective way 
of contact. Personal visits to former student addresses so proved ineffective 
and was, in addition, a more expensive method. 

It is also apparent that these former students are quite mobile - a large 
number being totally inaccessabie. This fact raises the question of the utility 
of follow-up of large numbers of students by mail. (See Appendix C) 

b . Fol low-up of emplo^rs of former students 

Over half (56%) of the former students who responded by mail did give their 

permission to contact their employer. The "employer" contacted was the direct 

supervisor of the former student/employee. Of the 37 employers contacted, 10 

(27%) responded by mail and 25 (68%) by telephone for a total response of 95%. 
(See Table 2) 

CTeairTy,' telephone follow-up of employers proved to be a very successful and 
relatively inexpensive method of employer contact. (See Appendix C) 

'c. Discussion of student and employer questionnaire 

The main section of both the student and the employer questionnaire was designed 
to provide quantifiable responses. Activity statements pertaining to specific 
electronics courses were listed and two responses were obtained for each state- 
ment; (1) How important was the listed activity for required job performance, 
and, (2) How well (did the class) prepare the student for the listed activity. 
Statements were arranged in ascending order of course complexity. Responses 
were placed on a 1-6 scale to show Low-High importance and mastery. 
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4. Analysis of findings, comparison of student and employer responses 

Course by course comparison of student and employer responses shows considerable 
correlation. E.g., both groups believed that understanding of Electronics 
principles (Q.l) and knowledge of electronic math (Q.7) were very important; 
both groups indicated that the courses were effective in preparing the student 
in these areas. (Table 3, 4 & 5) 

Specialty courses (e.g., radio (Q.8), television (Q.9)), generally received 
lower ratings for both importance and mastery by both students and employers. 
This is die in part to the larger number of assembly jobs held (12) compared 
to Rad;.>r/ jobs (2). (Table 3. 4 & 5) 
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|; TABLE 1 

I : ELECTRONICS FOLLOW-UP SURVEY INFORMATION - STUDENTS 

tiff'-. 

li Total first student mailing 480 
Results of telephone follow-up (All who had numbers listed were called. 



f Numbers were obtained from registration files.) 

I J A/ Moved - no contact possible 19 

B. Called but could not reach J 100 

2 39 

C. Wrong number/no correct number available. 

3 

D. Disconnected/no new number. 20 

E. Student stated questionnaire not applicable 7 

F. Student unwilling to respond. 11 
— :\ G. Student contacted/would mail questionnaire/did not. 69^ 

Total contacted & mailed second questionnaire. 265 

Students unable to trace (37%) - 178 

Total students contacted and/or responded. (302/480=63%) 302 

I Students contacted by mail and telephone, but with no 236 

J ' response. (236/302=78%) 

Total usable student response (66/480 = 14%) 66 

1^,. Students disaKproving employer contact 29^ 

li Total employer contacts (37/60 = 56%) 37 



Notes: 1 - Five visitations were made: all were apartments. No one at address. 

2 - Five visitations were made: no one at address. 

3 - Five visitations were made: no one at address. 
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TABLE 2 

ELECTRONICS FOLLOW-UP SURVEY INFORMATION - EMPLOYERS 

f 



Response by mail (27%) "1° / 

Response by telephone (60%) £ii j 

Total responses (95%) . 

Employer not reached ' ' 

Employer not interested i 
Total employers surveyed 37 

TABLE 3 

SUMMARY OF STUDENT FOLLOW-UP RESPONSES 

Total Respondents: 66 

1. Received: Certificate 8 (12%) ; Associate Degree 8 (9%) 

2. Job Status: Working Full time 51 (77%) ; Part-time 4 (6%); Not ..-or king 11 (16.7% 

3. Type of Job: Electronics 31 (47%) ; Electronic related 25 (38%); UnrelatedJOLlI 

4. If job is Electronics related: Assembly 12 (18%); Radio-TV 2 (3%); Other_41ji2 

5. Monthly Salary (Fully Employed): 

0-$400 3_ $700-800 _J_ 

400-500 3 800-900 _0_ 

. 500-600 3 900-1000 2 

600-700 2 + iOOO 36 



Total : 51 
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f \ . TABLE 4 STUDENT TALLY 

li ' \ STUDENf ELECTRONIC TECHNQLOnY n ilF<;TTnNMflTDp 

, — 

I Student Accounteitji lity Model 



March 1976 



ACriVlTIES PERFORMED "sHOULO ' ^ ~ 

How impbVTant is the How wFTl was the listed 

listed activity to activity mastered in 

J.Ob? our courses? 



EXAMPLE: 



lot-i , ...Understanding of AC-DC Theory ^'^^ »igh 

1. Understanding Electronic principles-induct- ~^ 
*}"^^» capacitance, semiconductors, rectif-^^i-N ,^m^ 

.ers,^..pl1fiers. (100/H123) 1 /T) 4 jlTJTT^ 

r33 2. Application of Biasing, small signal an- —"^^ ^( f ^ 

alj/sis and frequency response; power am- 
plifiers; oscillators; modulation; 

system concepts. (125/ElOl) (g>__4 / 3 3 <^ 3/ 3 / 5 / 8/^ 

; 31 3. Number systems; arithmetic and memory 1 ^J T^ . '"T-T^ ir ■ !■ 

:/ elements; counters; input/output basic ^--^ 

• , ^'''^''''''> ©-iiiiaLsj© 2/3rT7T%4/3 

i 29 ^- 'Application of microwave propagation and - " — 

fiieasurenient for communications, missels ri, 

and radar systems. (163/F108) © 3/0/2 / 1 /?) (?) 3 / 3 /4> 3 / 1 

30 5. Fabrication and as<^r;'bly i.so of hand ""^"^ ^ - 

and fMachino oporations. (hllO) CP ^^^-C^Lj / ^ ^ / 3 / ^?7^ 3 

3V: 6. Radio ar.d TV sc-rvicing i3nd trouble- _,- ' * — 

; shooting. (f:ii2) ©J-^O^M /_3 © 3 / 2 /d> 3 / 2 

3,5 7. Knov/led'je of Electronic math including — - r^S^r-—-— • Va^ 

"'•'^ of ^I'^'e rule and calculators. (E120) (n }' 3/4/ 2 1 ^^7 / 8^ 4/ 0>^^^ 3 
;.27 8. Understanding of pi'inciples of radio re- " ' 

ceiver- transmitter theory and evaluation y^, ^ 
for FCC license. (E124) ©-Z^/-3.X.0^J^ (s^OiTTlil / 1 

28 9- Understanding television circuits, video ^ 
signals, antenna systems, repair; cus- 

tomer relations. (E152) ©. 5_/_3_/ 2__/.,0JL2 (TJ^ Z /S^I / 1 

31 10. Linear integrated circuits; cp-anps, ^^m^ 

diff-amps; regulators. (161B) (I1)J-/JjL1../„5^ 3/ 3 J^S /"4> 1 /.3 

30 n. Making precision n:na';Lirf?n)ents including . . ' 

error analysis; use of r.pasuring instru- ^ 

ments. (E162) €^.JJJUJ.A^J8) 3j_ 2 

28 12. Introduction to conputtirs and micro r-i^ 

processors. (175) GI/JLLIjLL^^ ^ 5/ 1 

LASER TECHNOLOG Y (A Specialty) " 
' ' * Hease rate the courses you did take. Useful ' "Sse""" 

6 13. Knowledge of laser principles includ- ' 

ing such type?; as Ruby and 1/AG; glass 

fabrication techniques. (LlOO) 2 1 

6 14. Knowledge of Laser optics (LlOl) 2 0 

5 15. Knowledge of and operation of pulsed "~ 
and CW laser equipment. (L102) 1 0 

5 16. Making laser measurements using spp»ct- 

rom.eters, nionochromomoter , spectrophoto- 

rneters, spectrum analyzers. (L)ll) 2 0 

6 17. Knowledge of behavior of gases, pressure ~ 

measurcrirrnt, gas type vacuum pumps, 

vacuum evaporation techniques. 2 0 
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TABLE 4 (Continued) 



VACUUM TECHNOLOGY (A Specialty) 

18. Application of physics, chemistry 
and math to vacuum processes; vacuuiji 

device fabrication (V165) 6 2 4 

19. Understanding of vacuum systems as 
applied to metalizing, freeze drying, 

etc. (V166) 6 2 4 

20. Understanding and application of thin 
film techniques, including process 

used in film deposition. (V167) 6 1 4 

21. In what areas should training be expanded? Digital Circuits 11 ; Analog _6 

Radio & TV Repair 1 ; Electronic Assembly 5 ; Use of test equipment 18 

22. List activities considered important but not indicated above. {Single comments) 

Lab equipment relative to thin film technology end hands on use training needed. 

Interfacing with industry (field trips and guest speakers) 

As part of technology courses - equipment manufacturers are good source of 
input that is current. 

More emphasis on better quality instruction 

Computer technology 

a. Data Processing 

b. Computer programming 

c. Data gathering, i.e., use of various sensors and interfacing with computer 

processors 

Keeping vacuum systems clear 
Basic information needed: 

a. Weldinc for vacuum systems 

b. Assembly of different types of vacuum systems 

c. More gas analyses and metalurgy 

d. Semiconductor metal ization 

e. Electron beam operation and characteristics 

f. Understanding substrate req current 

g. Lab course on the implementation of Boolean Algobr^ using digital integrat 

circuits 

Satellite related theory (Cryogenics, etc.) 

Communication circuits and equipment 

WorMng with a large high volume machsne shop 
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jABLE 5 EMPLOYERS TALLY 

fjyj-PlglJl-iCJRQ^^^ T'ECIINQL OGY QUF.S TIQnNAIRE 
Student Accountability Model March 1976- 

Name of Company . 

Address 

City Phone _ 



Number of employees in Electronic related technology entry level positions 



ACTIVITIES PERFORMED .SHQyLD ' _IS 

How important is the How well prepared was 

listed activity for the ex-student to per- 

required job perfor- form the listed activ- 

mance? ity? 



EXAMPLE: Low High Low High 

'Otal Understanding of AC-DC Theory ' ^ _ 

Responses N^etwork Systems CIRCLE ONE 1 /2/3/4/5 /(^ 1 /t P/ 3/4/5 /6 

26 1. Understanding Electronic principles-induct- 

ance, capacitance, semiconductors, rectif-' '^.-^ ■ ^ 

lers. amplifiers. (100/E123) 1 4 p /^V 4 0/1/4/3 2 

23 2. Application of Biasing, small signal an- 

alysis and frequency response; power am- 
plifiers; oscillators; r:odulation; /r% o /P\ o A o o yfT^ 

system coMCbpts. (l?5/K101) QJ ^ QJ ^ 1^1 ^ ^1^1^ ^ 

20 3. !i'u!"bor systems; arithmetic and memory 

i?lcrnr:iits; counters; input/output basic o /i o o i /O i oyT^ 

logic circuits. (1G'1/E161A) 3 / 2 C^J 3/4/2 2/ 1 /^/ 1 / 2 (^J 

21 4. Application of microwave propagation and 

i.'.oasuroment for coinmunications, missels ^**S >«m 

.md radar systems. (163/E108) 2/1 /4 / 4Q^/ 4 GjJV^/ 2/2/1/3 

25 5. Fabrication and assembly use of hand ^i**'^ ^ « « , ^ \ r"") 

and machine operations. (EllO) 2 / 1 / bf^M I 5 2/2/1 lf^TA^j3_y 

17 6. Radio and TV servicing and trouble- .^0^^ , ^ , ^ a -i 

^' shooting. (E112) <g > 2 / 1 / 2 ;2 / 1 ILISA.IaJlIL 

20 7. Knov/lcdge of Electronic math including , , . i n 

^J^e of slide rule and calculators. (El 20) ik^ 3/ 1 Hj jl 2 1/ 2 CWl'^J fJl 2 

17 8. Understanding of principles of jadio re- 

ceiver-transmitter theory and evaluation ^.^r^ , .^^^Tv, ^ ^ o 

for FCC license. (1:124) Q) 1 / 3/ 2y_2 <3g.1 / 3 / 1/0/2 

20 9. IJnderst.inding tnlovision circuits, video 

si(jf)als, antenna systrms, repair; cus- ^ , ^— « « 

toMcr r^ations. (nb2) (^JjXl /-?/_ 2 Z 2_y J Q) 1 /(^ 2/ 2,/, 2,... 

19 10. Linear integrated circuits; op-amps, ^.^^ 

^ - - diff-amps.; regulators.. (161B).-:.^ .. -C^ ^/.A^ Z J2^ I .2 Z.J^ .3 .LZ ./:Z ... 



22 !!• ^''aking precision measurements ihcluding 

error analvsis; use of measuring instru- — 
n.cnts. (tie?) 

iy 12. Ifitroduction to computers and micro 



n.cnts. (tl62) 



processors. (1/5) ^ 0 2/2/2 ^^.U.O. /._!/. _3_/lO 

13. In what areas shiould training be expanded? Digital Circuits";^J^ f Analog ; 

?yvMo TV R.-.;\-ijr ; n.r.tronic A-'.scmbly ; Use of tost equipment Sne next page 

14. List aciivitios tonsidf_-red important but not indicated above. 

1. Sales of ejectricaj_ parts^ Progr aini ng :(a ) Circuit trouble 

?. shooting .(b|. ali.ility-io-partition-ror,ipu-te»^-Sy-^tGms:±Q Jacate^fauns 
O 3 Vaaium Systems - thin film tejchniques._ Principals of business - the problems 

ERIC facing "bus mess a'nd'how employees" help soive^ these problems (or create them) 



TABLE 5 (Continued) 

In what areas should training be expanded? 
Digital Circuits: - Use of test equipment 
Digital Analog - Use of analog test equipment 
Electronic Assembly - Use of test equipment 




\ EMPLOYER ELECTRONIC TECHNOLOGY QUESTIONNAIRE 



Student Accountability Model March 1976 

Name of Company - ' 

Address ^ 

City Phone 



Number of employees in Electronic related technology entry level positions 



ACTIVITIES PERFORMED 




SHOULD 


IS 










How important is the 


How well 


prepared 


was 






1 isted activity for 


the ex-student to 


per- 






required job perfor- 


form the 


listed activ- 






mance? 


ity? 






EXAMPLE: 




Low High 


Low 




High 


Understanding of AC-DC 


Theory 




1 //D/ : 




Network Systems 


CIRCLE ONE 


1 / 2 / 3 / 4 / 5 /© 


5/4/5 


/ 6 



1. Understanding Electronic principles-induct- 
ance, capacitancei semiconductors, rectif- 
iers, amplifiers. (100/E123) 1/2/3/4/5/6 1/2/3/4/5/6 

2. Application of Biasing, small signal an- 
alysis and frequency response; power am- 
plifiers; oscillators; modulation; 

system concepts. (125/ElOl) 1/2/3/4/5/6 1/2/3/4/5/6 

3. Number systems; arithmetic and memory 
elements; counters; input/output basic 

logic circuits. (104/E161A) 1/2/3/4/5/6 1/2/3/4/5/6 

4. Appliqation of microwave propagation and 
measurement for communications, nissels 

and radar systems. (163/E108) 1/2/3/4/5/6 1/2/3/4/5/6 

5. Fabrication and assembly use of hand 

and machine operations. (EllO) 1/2/3/4/5/6 1/2/3/4/5/6 

6. Radio and TV servicing and trouble- 
shooting. (E112) 1/2/3/4/5/6 1/2/3/4/5/6 

7. Knowledge of Electronic math includ'ing 

ufee of slide rule and calculators. (E120) 1/2/3/4/5/6 1 /2/3/4/5/6 

8. Understanding of princip'ies of radio re- 
ceiver-transmitter theory and evaluation 

for FCC license. (El 24) 1/2/3/4/5/6 : / 2 / 3 / 4 / 5 / 6 

9. Understanding television circuits, video 
signals, antenna systems, repair; cus- 
tomer relations. (E152) 1/2/3/4/5/ 6 1/2/3/4/5/6 

10. Linear integrated circuits; op-amps, 

d i f f anps ; r eg ii 1 a t or s . O'b f b) 1T2 /" jT 4 / 5 / 6 " 1/ 2 / 3 / 4/5 /.S 

11. Making precision measurements including 
error analysis; use of measuring instru- 
ments. (E162) 1/2/3/4/5/6 1/2/3/4/5/6 

12. Introduction to computers and micro 

processors. (175) 1/2/3/4/5/6 1/2/3/4/5/6 

13, In what areas shoul^j training be expanded? Digital Circuits ; Analog ; 

Radio & TV Repair ; Electronic Assembly ; U^e of test equipment 



14. List activities considered important but not indicaced above. 



STUDENT ELECTRONIC TECHNOLOGY QUESTIONNAIRE 



Student Accountability Model 



March 1976 



ACTIVITIES PERFORMED 



SHOULD 
How important is the 
listed activity to 
your job? 



IS 



How well was the listed 
activity mastered in 
our courses? 



EXAMPLE: 

Understanding of AC-DC Theory 
Network Systems CIRCLE ONE 



Low High 

1/2/3/4/5/6 



Low High 

1/2/3/4/5/6 



1. Understanding Electronic principles - 
inductance, capacitance, semi- 
conductors, rectifiers, amplifiers. 
(100/E123) 

2. Application of Biasing, small signal 
analysis and frequency response; 
power amplifiers; oscillators; 
modulation; system concepts. {125/ElOl) 

3. Number systems; arithmetic and 
memory elements; counters; input/ 
output basic logic circuits (104/E161A) 

4. Application of microwave propagation 
and measurement for communications, 
missiles and radar systems (163/E108) 

5. Fabrication and assembly use of hand 
and machine operations. (El 10) 

6. Radio and TV servicing and trouble- 
shooting. (El 12) 

7. Knowledge of Electronic m^th including 
use of slide rule and caleuiators. (E120) 

8. Understanding of principles of radio 
receiver-transmitter theory and evalu- 
ation for FCC license. (E124) 

9. Understanding television circuits, video 
signals, ^nte^na systems, repair; 
customer relations. (E152) 

10. Linear integrated circuits; op-amps, 
diff-amps; regulators. (161B) 

11. Making precision measurements 
including error analysis; use of 
measuring instruments. (E162) 

12. Introduction to computers and 
micro processors. (175) 



1/2/3/4/5/6 

1/2/3/4/5/6 

1/2/3/4/5/6 

1/2/3/4/5/6 
1/2/3/4/5/6 
1/2/3/4/5/6 
1/2/3/4/5/6 

1/2/3/4/5/6 

1/2/3/4/5/6 
1/2/3/4/5/6 

1/2/3/4/5/6 
1/2/3/4/5/6 



1/2/3/4/5/6 

1/2/3/4/5/6 

1/2/3/4/5/6 

1/2/3/4/5/6 
1/2/3/4/5/6 
1/2/3/4/5/6 
1/2/3/4/5/6 

1/2/3/4/5/6 

1/ 2 / 3 / 4/5/6 
1/2/3/4/5/6 

1/2/3/4/5/6 
1/2/3/4/5/6 
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LASER TECHNOLOGY (A Specialty) 



Very MediVm Little 

Useful Use^ Use 

Please rate the courses you did take, 

13. Knowledge of laser principles includ- 
ing such types as Ruby and 6/ AG; 
glass fabrication techniques, (LlOO) 



14. Knowledge of Laser optics (LlOl) 



15. Knowledge of and operation of pulsed 
and CW laser equipment. (L102) 



16. Making laser measurements using 
spectrometers, monochromometer, 
spectrophotometers , spectrum 
analyzers. (Llll) 



17. Knowledge of behavior of gases, 
pressure measurement, gas type vacuum 
pumps, vacuum evaporation techniques. 

• VACUUIVI TECHNOLOGY (A Specialty) 

18. Application of physics, chemistry 
and math to vacuum processes; 
vacuum device fabrication (V165) 



19. Understanding of vacuum systems as 
applied to metalizing, freeze 
drying, etc. (V166) 



20. Understanding and application of 

thin film techniques, including process 
used in. film, deposition, (V167) 



21. In what areas should training be 

expanded? Digital Circuits ; Analog 



Radio 6c TV Repair ; Electronic Assembly ; Use of test equipment 

22. List tictivities considered important but not indicated above. 

L 

2. 



3. 
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Action 

a. Surrmary of questionnaire findings 

Of the students responding (66) 21% (14) either an AA or certificate at SJCC; 
83% were working full or part-time; of those working, S5% were in electronics 
or related occupations. Of those working full time (51) over 74% were earning 
$1,000 or more per month. 

Students rated of highest importance to their jobs such basic courses/training 
as lOOAB - General Electronics, 125A,B,C - Circuits and Systems Analysis, and 
120A,B - Electronics Math. Most students agreed that they had learned these 
basics moderately to excellently in their courses. 

Most respondents indicated that extension courses were of low importance to 
their job. But they indicated that they had learned these course activities 
moderately wel 1 . 

Responses grouped themselves bi- and even tri- modally, this suggests a rather 
wide variety of occupational choices and corresponding differences in prevalence 
of course content to job demands. 

In open-ended responses students emphasized a need for (1) a considerable ad- 
ditional body of basic information and skills, and, (2) additional emphasis 
on computer technology. 

b. Dissemination 

Sufficient copies of the completed follow-up report, sections 1-4, were copies 
'^for dissemination to all electronics instructors. The copies were for.vard'^d 
to the chairperson for distribution, review and discussion. 

hi » 



c. Impact on college prograrii 

A request was made of the department chairperson for departmental response to 
the following: 

1. Utility of the questionnaire format. 

2. Utility of the student and employer responses. 

3. Problems/concerns regarding the questionnaire or the follow-up process. 

4. Indication of any planned modification or change. 

d» General Summary of project 

This type of SAM follow-up, with its employer emphasis, tends to confirm student 
r;nowup information. The low number of employers contacted presents a problem. 
This may i.ave been due to the imposed constraint to obtain signed student re- 
leases before contacting e.Tployers. 

e. Summary o f employer findings 

Employer responses correlated very well with student responses. This finding 
tends to reinforce the importance of the information received. 

Employers tended to believe that additional training should be given in sales 
of electrical [.arts knd in principles of business. This suggests that some 
former students are finding jobs in parts houses rather than just in assembly 
and repair. 

Employers also emphasized an additional need for student training in computer 
technology - trouble shooting, maintenance and repair. 
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6 . ReGommendations for design of future employer foUow-up activities 

a. Student awareness to prospective contact and employer followup should be 
developed prior to the end of the school year in June. 

b. Employers tend to not respond by mail alone. The following procedure is 
recommended: -0 

1. Mail questionnaire with letter indicating that the e.Tiployer will be 
contacted within ore week by telephone. 

2. Plan telephone call or other personal contact within one week. 

3. Be persistant with telephone calls - indicate that the telephone inter- 
viewer will call again. 

4. Print sufficfent questionnaires that telephone interviewer can fill 
in blank copies from employers verbal response. 

c. Keep questionnaire to one page. 

d. Avoid open end responses. 

e. The group of students and employers to be surveyed should be relatively 
limited, (e.g., day students only) 

f. Clarification should be obtained concerning the legal aspects of obtaining 
student signoffs in order to contact employers. 

GSO:sm 6/9/76 
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ATTACHMENT A 
2100 Moorpark Avenue 

San Jose, California SSI 28 



^ (408) 208-2181 

SAN JOSE CITY COLLEGE 



Dr. Th«odor« I. Mureui« 

President 



San JoM Community College District 
Board of Trustees 
John R. Brokenshire 
Gael Douglass 
Dr. John E. Marlow 
Virginia Sandoval 
Yancy L. Williams 

Otto Roemmich 
District Superintendent 



March 19, 1976 



TO: 

FROM: San Jose City College Student Accountability Model, 

Dr. Lois A. Callahan, Dean of Instruction: Occupational Education 



RE: Follow-up Questionnaire 

An important task of San Jose City College is to adequately provide its occupational 
majors with the skills and experience for the world of work. Evaluation of our pro- 
grams by former students, such as yourself, can help us determine if we are meeting 
this continuing goal. All students who completed .*;his program in 1974-75 are being 
asked to respond. 

Attached is an evaluation questionnaire which we would like you to complete. In 
order to facilitate the return process, a self addressed stamped envelope is enclosed. 

We are also asking for your permission to contact your employer with a similar question- 
naire to help determine employer opinion of the quality of our program. Please return 
the questionnaire by Friday, March 26, so the survey can be sent to your employer by 
Tuesday, March 30. If you have not returned the questionnaire by the weekend of the 
29th of March, a student employee will visit you in case yon need clarification. 

We thank you for answerinn the questionnaire that will help us improve our programs. 
I give permission to have my employer contacted. _ 



(Signature) 



Company Employed By: 



Address: City 



Direct Supervisors Name Work Phone No. 

Please check: 

!• Received certificate , or Associate degree . 



2. Job Status: Working ; Full -time ; Part-time ; No 

3. If Working, Type of Job: Electronics Electronics Related ; Unrelated_ 

4. If Job is Electronics Related: Assembly ; Radio-TV ; Other 

5. Monthly Salary: $0-$400 ; $400-5500 , $500-$600 ; $600-$700 \ 




$700-$800 . $800-^0pj^ ; '$900-$l ,000 ; Over $1,000 



APPENDIX B 

TIME LINE - SAM 
EMPLOYER FOLLOW-UP 

March 17-19 Cossey & Viork Experience studerits. 

Obtain former student addresses, phone numbers and 
mail employee questionnair^e, 

March 25 Determine number of employee returns 

March 26-27 Address and mail first group of employers questionnaires. 

March 28 Conduct telephone and person?J contact of student/employea \ 

returning questionnaire 

March 29 Complc-te mailing of eK.ployer^s questionnaire 

March 30 - Cont: iL.e celephcne contact of students and employers who 
April TO have not returned questionnaire. 

April 10 Regin -alley of data from student questionnaire. 

April 10-20 Begin talley of data from employer questionnaire. 

April 20 Complete all employer and telephone interviews. 

Hay 16 Complete data analysis and preliminary report 
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APPENDIX C 



SAN JOSE CITY COLLEGE 
, • • SAM - EMPLOYER FOLLOW-UP 

ESTIMATED COST TO CONDUCT 

Note: Our big expense was in dtteiiipting to obtain written student approval 
to contact eiflployer. This estimated cost to conduct will assume- that 
student signoffs wi 1 1 .hot be n^quired. 



Develop and type questionnaires $ 50.00 

Office Personnel (typing, mailing, etc) 100.00 
Printing 25.00 
Supplies and Postage 50.00 
Telephone Interviewer (50 hrs, @$3.00) 150.00 

$385.00 



Number of students/employers (est.) 

Students 200 
Employers 100 

30P Total . 



Estimated cost per follow-up contact: $385 - $3.00 = $1.28 



Appendix F 



EMPLOYER f OILOW-UP 
CALIFORNIA COHMUNITY COLLEGES 
OCCUPATIONAL STUDENT ACCOUNTABILITY MODEL 
SHASTA COLLEGE 



Eve-M£it:ie Arce 
Field Test Coordinator 
Jiine^ 1976 
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INTRODUCTION 



Shasta College is one of four community colleges in California partici- 
pating in the Eiaployer Follow-Up project, an extension of California 
Coiomunity Colleges Occupational Student Accountability Model (S.A.M.) The 
Employvar Follow-Up Project, sponsored by the Chancellor's Office, California 
Community Colleges, is coordinated at San Jose Community College District, 

The primary objective of the conBOrtium-based study is to develop a 

tested system for collecting from employers of former students evaluations 
of the training programs. 

Each of the four colleges taking part in this study has developed an 
individual plan for employer follow-up, initially considering local needs. 
Field test results from participating colleges will be reviewed in June, 1976 
by the forty-six member consortium before being distributed statewide. 

PURPOSE OF THE STUDY 
The intent of this study was to test alternative methods for gaining 
information from employers of former students in the evaluation of occupa- 
tional training. The following objectives were listed as important to local 
needs: 

1. To develop an accurate description of target jobs. Include 
a description of duties and responsibilities, pay and bene- 
fits, and education and experience requirements. 

2. Develop job markets for future program completers-. 

3. Modify the existing educational programs to better conform 
to current industry requirements. 
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Colleges were given the option of designing a plan to follow up employ- 
ers of all occupational education students or to narrow the population of a 
particular cluster or specific program. Shasta College opted to focus on 
three occupational areas to obtain specific information related to the local 
college objectives. 

Listed below are the programs and primary raasons for inclusion in this 
project as stated in the project proposal: 

1. Early Childhood Education 

In the Spring 1975 follow-up of students, this program 
showed a low completion figure compared with the total 
number of students enrolled in the program. The intent 
of the employer follow-up for this occupational major 
was to review program requirements for current job place- 
ment. 

2. Computer Science/Keypunch Operator 

The data processing industry is undergoing rapid tech- 
nological changes. The purpose of employer contact for 
this occupational area was to assess future needs of the 
industry in order to adapt the training to technological 
changes . 

3. Log Truck Driving 

The purpose of the employer contact in this occupational 
program was to ascertain the effectiveness of this 
newly-initiated certificate program. 



BACKGROUND 

Since 1974, Shasta College has participated in the statewide S.A.M. sys- 
tem, which was developed to measure the effectiveness of California Coinmunity 
Colleges' occupational training program. With the S.A.M. system, the college 
has the capability of identifying and classifying occupationally educated stu 
dents. S.A.M. gathers from former students such information as whether they 
are, working ..in the. .occU{)attoxt«jl JEiald.ior . which pr^epared, and was the 
training relative to job requirements. Shasta College sent follow-up 
\ 
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questionnaires (Appendix, page 1) to students who had taken at least two 
substantial classes In a terminating major at the close of spring semester 
1975. Findings from the Spring 1975 S.A.M. follow-up of former Shasta Col- 
lege students have been tabulated (Appendix, pages 2-5). 

The Employer Follow-Up Project extends S.A.M. 's goaj of Improving 
occupational training by requeniilng feedback from actual employers of former 
Shasta College students « 

In this study, the following definitions were used: 

1. S.A.M. 

Student Accountability Model measures the effectiveness of 
California Community Colleges' occupational training pro- 
grams by providing a system for identification of occupa- 
tionally educated students and collection of feedback from 
these students. 

2. Employer Follow-Up 

S.A.M. Employer Follow-Up will be a system by which feed- 
back is obtained from employers of former occupational 
students. This program, in the developmental stage, in- 
tends to ask effectiveness of training for actual job and 
relative training needs for job reqv.irexants . 

3. Early Childhood Education 

Early Childhood Education, an occupational program at Shasta 
College, was developed in 1970. There were 124 students in 
Lhe program in Fall 1975, and 49 in Spring 1975. 

4. Computer Science and Keypunch Operator 

Computer Science and Keypunch Operation are two programs at 
Shasta College that were developed in 1967. During the 
Fall 1975 semester, there were 33 students in the Computer 
Science and Keypunch Operation programs. In Spring 1975 
there were 42 students in the two programs. 

5 . Log Truck Driver 

Log Truck Driving classes were first offered in Fall 1975. 
There were 18 students the first semester. 
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This project was limited by the following constraints: 

1. Number of returned S.A.M. follow-up questionnaires from 
students in the three identified occupational areas. 

2. Willingness of employers to participate and complete the 
questionnaires • 

3. Employers' knowledge of information requested. 

4. Time allotted for study. 

There were several assumptions made in this investigation which pro- 
vided further direction: 

1. Primary purpose of this project in the developmental 
stages was to identify and evaluate the method in the 
collection of data ini^tead of putting the information 
to practical use. 

2. This report focuses on the- presentation of methods and 
project def initio.'.. It is assumed that the actual suc- 
cess of the total Employer Follow-Up lies at the indi- 
vidual college level where staff and administration will 
need to understand the mechanics of the total S.A.M. 
project. 

METHOD 

Studexit population from the occupational programs included -iti this^ 
study was identified (Table I). Each student included met the following 
criteria: 



2. Re 

to^ 



1. Attended Shasta College in Spring 1975, then terminated, 
having completed at laast two significant courses in a 
terminacing major. 



umed the occupational student follow-up questionnaire 
Shasta College. 



3._ In^cated on the questionnaire that he/she had initially 

• b'een'''eTnpToyed'*"in a'^ jblD^ 'r to the occupational 

training program. 

Not ali-atudents respondir>g to the Spring 1975 follow-up study met the 
criteria listed above for the Employer Follow-Up Project. 
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TABLE I 

SHASTA COLLEGE STUDENTS 
INCLUDED IN BOTH S.A.M. & EMPLOYER FOLLOW-UP 



Occupational 
jrircKrani 


Total Students 
Identified 
SAM T?ol lou-Uo 


Employer Follow-Up 
N Z 


Computer Science/ 
^Ceypunch Operator 


21 


5 


24% 


Early Childhood Education 


6 


5 


83% 


Log Truck Driving 


23 


7 


30% 


jTot&l^^S tud^ents :^ 


50 


17 


j4% 



Seventeen employers were identified on selected student follow-up ques- 
tionnaires (Table II). Next, employers' addresses and phone numbers were 
obtained from the phone directories. All but one employer was located and 
sent the initial letter requesting cooperation in the study (Appendix, page G). 
The preliminary questionnaire was included with the initial letter (Appendix, 



page 7). The questionnaire listed nine items asking the employer to rate ele- 
ments of the triiining effectiveness. 



TABLE II 

EMPLOYERS INCLUDED 
IN EMPLOYER FOLLOW-UP STUDY 



Employer 


lli 


' r*? -O 

' W O w 


/ 


1 

/ Address 
£c Phone 


/ Contact / 
/ Person / 




o a ^ 

o CO jJ5 




( 




— 1 

Bill Schmitt 

. l4P??tlXg . , I 






X 


1701 Clear Crk.Rd. 
Redding, CA 96001 
243-3069 


Bill Schmitt 


Continental Trail- 
ways 






X 

■ 


1748 Market Street 
Reduing, CA 96001 
241-2331 

f 


Mrs . Wins low ^ 
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TABLE II* EMPLOYERS INCLUDED IN EMPLO'fER FOLLOW-UP STUDY (CONTINUED) 



Employer 


/i? « 
It- 

o ^ 




/ J- 

/ ^ 


/ 


/ 

/ Address 
/ & Phone 


J 

/ Contact / 
' Person / 


Der Kinder Garden 
Pre School 






X 








2019 Artesia Blvd. 
Redondo Beach , CA 
90278 




Eiranett Baugh Co. 










X 




1610 West Street 
Redding, CA 96001 
243-1696 


Norbert St. Marie 


Kiddie Kastle 

Nursery School 






X 








2800 La Loma Drive 
Rancho Cordova, CA 

95670 
363-2800 


Barbara Parsons 


Charles C. Meek 
Lumber Company 










X 




3048 Market Street 
Redding, CA 96001 
243-0312 




N,T. Enloe 

Mem* Hospital 


X 












West 5th and 

Esplanade 
Chico, CA 95926 
342-1841 


Chuck Pagoni 


North Valley 
Pre School 






X 








2960 Hartnell Ave. 
Redding, CA 96001 
243-6414 


Sandy Schlappy 


North Sacramento 
School District 






X 








700 Dos Rios Blvd. 
Sacramento, CA 

95814 
448-6369 


Sybil Batty 


Pacific Farms 










X 




P. 0. Box 252 
Gerber, CA 96035 
385-1475 




R. J. Hansen & 
Associates 


X 












555 Capitol Mall 
Sacramento, CA 

441-7232 


Robert Hansen 


Redding Elementary 
Schotxl District 
(Cypress School) 






X 








P. 0. Box 2418 
Redding, CA 96001 
243-2332 


Bee Currie 
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TABLE II: EMPLOYERS INCLUDED IN EMPLOYER FOLLOW-UP STUDY (CONTINUED) 



Employer 


S § § 

' ^ flj 

3 


/"So 
/ S 

/ ^ 


Is 


/ Address 
/ & Phone 

/ 


/ Contact • / 
/ Person / 

1 1 


Eledding Record 
Searchlight 


X 






p. 0. Box 2397 
Redding, CA 96001 
243-2424 


Bill Darley 


Royal Sierra, Inc. 






X 


Could not locate. 




7-11 Trucking & 
Gen. Engineer. 






X 


17713 Redbud Lane 

960S9 
275-2482 


Don Bova 


Simpson Lee Paper 
Company* 


X 
X 






P. 0. Box 637 
Anderson, CA 96007 
365-2711 


Frank Watters 


Totals: 


s 


5 


7 







*Employer of two students. 

Phone calls were made to employers to arrange for personal interviews 
A summary of employer responses is provided in Table III. 

TABLE III 
EMPLOYER PARTICIPATION AND CONTACT 



ERIC 



Occupational 
Programs 


f N 




; ■ 

/ i S 


/ ? « / 
/^°^'^ / 


' H 1 


N 7o 1 


N % / 


Computer Science/ 
Keypunch Operator 

Early Childhood 
Education 

Log Truck Driving 


5 

5 
6 


4 

4 
1 


1 
3 


5 100% 

4 80% 
4 67% 


1 20% 

2 33% 


Totals: 


16 


9 


4 


13 81% 


3 19% 


^^An employer is considered to 


have part 


icipated : 


n this stu 


dy if a personal 



interview was held or written questionnaire rf turned. 
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During' the interviaws with employers, a standardized interview form 
(Appendix, page 9) was used. After the customary introduction and refer- 
ence to the initial letter, it was reemphasized that the project was not 
evaluating the performance of the individual student. A brief description 
of the overall S.A.M. project was provided. The employer was invited to 
ask questions about the project. Attention was drawn to the standardized 
interview form, since notes were taken during the interview. Although an 
attempt was made to systematically follow the standardized interview form, 

employers wer^i given the opportunity to elaborate. Preliminary question- 
ing, -* _ 

naires were collected at the conclusion of the interview. 

Two. employers were not willing to participate in interviewsj^ but did 
agree to complete the questionnaires by mail. Time schedules did not per- 
mit interviews with two other employers who did agree to participate. 
Second letters (Appendix, page 11) with both the preliminary questionnaire 
and standardized interview form were mailed to these four employers. 

Letters of appreciation (Appendix, pages 12 - 13) were sent to employ- 
ers who participated in the interviews and to those who mailed in the infor- 
mation. 

FINDINGS 

This first section of findings is based on the data obtained from the 
nine questions asked on the preliminary questionnaire (Appendix, page 7). 
Numbers of employers responded to each item, and therefore the N shown with 
each item varies. 

Preliminary Questionnaire 

Item 1: Employers were asked to identify which of five skills 
were essential or non-essential to the job. Responses 
are outlined in Table IV. Responses were tabulated by 
occupation and for all employers who responded. 
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TABLE IV 



EMPLOYER VIEW OF SKILLS 
AS ESSENTIAL/NON-ESSENTIAL 



Computer/ 
Keypunch 



Skills 




Technical Knowledge - 

Operation of Equipment 

Writing Skills 

Verbal Communication 

Interpersonal Employee 
Rel*itlons 



N-11 



Item 2: 



The second Item on the questionnaire asked employers 
If there were other specific skills essential for the 
job. Since all employers did not complete this sec- 
tion, those responses that were listed are grouped 
below under occupational programs. 



Program 


Skill 


Computer Science 


Supervisory skills 
Accounting knowledge 
"Self-fltarter" 
Applications knowledge 
Directing cotnmittees 


Keypunch Operator 


Experience is critical 


Early Childhood Education 


Basic teaching :^ kills 


"Love and understanding of children" 


Log Truck Driving 


Log truck safety 


Good public relations 
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Item 3: Participants responded to item three by rating the 
effectiveness of the technical training provided 
by Shasta College. Responses are summarized in 
Table V. 

TABLE V 

EMPLOYER RATING 
OF TECHNICAL TRAINING 



Occupational 
Programs 



c 



13 
O 

a 























s / 





Computer Science/ 
Keypunch Operator 






1 


2 








Early Childhood Education 






1 


1 






Log Truck Driving 




1 


2 


1 






Totals: 


N 


7, 


N 


% 


N 


7, 


N 


7, 


N 


7, 


1 


117, 


4 


447, 


4 


447, 











o 



N=9 



Items 4-6: 



Item 7: 



Employers were again asked to review skills and 
rate the effectiveness of college .training in 
questions four through six. Participants rated 
the effectiveness of the programs at Shasta 
College in preparing individuals for pre-employ- 
ment procedures (i.e., the interview, the 
application, personal presentation) and in 
or-lenting individuals to employment (i.e.; work 
attitude, attendance, cooperation with co- 
workers and with management) . This data is 
outlined in Table VI (Page 11). ^ 

Responses to Item 7, in which the employer rated 
the importance of occupational training in rela- 
tion to other qualifications in the hiring deci- 
sion, are presented in Table VII. 
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TABU VI 

EMPLOYER RATING OF EmCTIVENESS 
OF SKILL TRAINING, JOB FREPAREBIIESS AND EMPLOYMENT ORIENTATION 




12 

TABLE VII 

IMPORTANCE OP COLLEGE DRAINING 
IN REUTION to OTHT-R QUAX.IF1CATI0NS 
IN EMPLOYER'S HIRING DECISIONS 



frogram^ 


1 ' 

/ ^1 


/ 


/ 3^ 


/ 

/ 


"1 / 

o / 


Computer Science/ 
Keypunch Operator 


1 


2 


1 






Early CblJdhood {Idiication 




2 








Log TrucU Hrivin^ 




2 


2 






Totals: 


I 


6 


3 





N=10 



Xhe seconcJ part of this section on findings deals with information 
gathered from che standardize int^^rview fontt (Appendix, page 9). There 
were nttie peratPtial interviews held With employers. Two v>:ltten questionnaires 

completed by eijjployers were retume4^ On som^ items from the standatrdized | 
interview fo.m^ data coll<icted from interviews is presented separately from 
the written responses. Written responses ar^ identified with an a^tfirik. 

Standardised Questionnaire 
Xhe first section of the stand^t'dized interview questioned the employer 
abont tlivi posit; ion for which the fo^er student was hired, Infomuition col* 
leci<:id regarding job titl^j duties and responsthllities , pay range, benefits 
and minimum an6 prt;ferred education ^nd experience is summarized the fol- 
lowing pages (i^Ages 14 - l6). Information de.rtved from each employer 's 
categorized by occupational area, k^^ping data from respondentr. together. 

, 137 

o 

ERIC 



13 

Specific employers are not identified, since it is the occrKpational training 
program and process for collecting data that is being evaluated instead of a 
comparison o£ employment locations. 

Job duties and responsibilities have been surnmarized for the report from 
the written and oral description provided by the employers. 



i'ss 



Job Title 



Duties i 
Resgonsibilltlea 



COMPUTER ECIENCE 
KEYPUNCH OPEKATOR 

MinitnuiD 

Benefits Zd ucaLion/Expericnce 



Education/Experience 
DesirAblfi/Preferred 



Promotion Oppcrtutii^les 
Additional :.equircqLgnts 



CoBputer Operator Operate NCR Century 50 $ 6?9 - 799 mo, 
Computer in accordance 
vith written proce- 
dures and Iwstructit^ns. 
Haintain disc libra^yj 
some peripheral duties 
in control clerk nni 
keypunch areas. 



Computer Programmer Progracuner, Writes $ 
computer programs, rfe^ 
. signs systems. 



Keypunch Operator 



Operation Supervisor 



Kftypuncher 



Keypunch ail input; 
prepare for couiputet; 
actual operation of 
computer* 

Responsible for sup^r^ 
vision of data coordi- 
nation, keypunch 
operation, computet 
operation. 



Keypunch, verify 
input from source 
documents; prepare ^ni 
maintain files of pro*^ 
graffl cards, nialntaifl 
manuals* 



- UOO mo. 



N/A 



$I1?3 - 1685 mo. 



$ 5?0 - ?00 mo. 



Medical 
Life Insurance 
Retirement Flan 
Sick Leave 
Vacation- ' 



High School 



Medical 

Life Insurance; 
Profit Sharing;; 

Medical 
Retirement 
Sick Leave 
Vacation 

Medical 

Dental 

Retirement 

Savinjis 

Vacation 

Sick Leave 

Medical 

Dental 

Retirement' 

Savings 

Vacation 

Sick Leave 



Two years of college, 
some experience « 



Two years of college, 
practical experience 
at college, 

Working at company in 
accounting- capacity; 
college accounting 
classes. 

Managerial skills; 
high school and compu- 
ter operation skill; 
varying amount of col- 
lege education 
accepted. 

High school 



College; keypunching 
with business type 
progranj; prefer t*^o 
years of college. 
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EARLY CHILDHOOD EDUCATION 



Job Title 



Teacher, Part-Time 



Assistant Teacher 
I, Substitute 



Duties & 
Responslbllltlea 



Pay Ranse Benefits 



Tetcher 



Instructional Aide 



In charge of supenlslor $2.20 - 3.00 hr. None for part- 
of children In child time; 1 week 

care and related duties, paid vacation. 

.-Supervises in afternoon after 1 year ' 

^ session. Substitutes . for full-time, 

"a^v^class. ' 

Assists in vartouj'gnaup $3,15 - ^.52 hr.' Hedic'al 
activities under the Approximately Dental 
direction of Teacher I. Retirement 
Assists with neals^ room Sick Leave 

preparation and .cj^eanup^ School Holidays 

Sfflall group instriictiion ; 
and with volunteers. ' ' 

Planning,, supervising $3.00 - 4.75 hr. Medical 
and impleinentlng program Vacation 
for class; prepare week- 
ly plan; meed individual 
needs of children; be 
responsible for records, 
room arrangement and, 
light housekeeping; at- 
tend staff meetings; pre- 
pare daily snack; attend 
conferences. 

Help children with read- Medical 
Ing and math K-6; type Dental 
stories and word lists; Retirement 
make home calls; attend School Holidays 

all inservlce meetings; 
supervise playground and 
in classroom when teacher 
working with other child- 
ren; use duplicating 
machine; make instruction- 
al materials; attend school 

.iunctlAOsiavolvlng child- .. . 

ren. 



Minimum 
Education/Experience 

12 college units as 
specified In Title 
22. It was noted 
that almost all em- 
ployees have at least 
an A.A. degree. 

Children's Cente'r Pcr- 

Qllt. 



Education/Experience 
Desirable/Preferred 

Experience in program 
as substitute before 
full responsibility 
of a class, 



Early Childhood Certi- 
ficate or equivalent. 



8th grade or higher 
proficiency in math; 
mature, responsible 
and able to organize 
tasks. 



Promotion Opportunities 
Additional Requirements 

Full-time ceacher, or 
assistant director if 
vacancy. 



"Experience Is very;; I 'J-iJull-time or Assistant 
important." Teacher II; no addl 

tional education 



Experience helps; , ..Assistant Director 
personaLi^tervleu., . .K^needs to be a vacancy) 

: , One year at this pre- 

;•; ,. • „school. 



"Compassionate" 
Flexible 



Educationally handi- 
capped or Education 
Hentally Retarded in- 
structional aide; no 
additional require- 
ments. 
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LOG TRUCK DRIVING 



Job Title 



Duties & 
Responsibilities 



Pay Ran^e 



Benefits 



Mlninuni Educ;iclon/Expericnce Proniotion Opportunities 

Education/ Experience Desirable/Preferred Additional Requlretr.ents 



Truck Driver 



*TTUck Driver 



Truck driver In log 
transport; haul ovn 
logging equlpnent; 
position truck; ob- 
sene scales while 
truck is being 
loaded; responsible 
for load until deli- 
very to mill. 

Drive trucki 



$4i'B0 - 5.20 hr. 
(60 hr. week aver- 



N/A 



High school; experi- 
ence in log trucking; 
a year before going 
out alone. 



None 



$3.00 * 4.50 hr. 



Health 
Vacation 



N/A 



"Minimal" 
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EMPLOYMENT OUTLOOK 



Employers contacted were also asked the following questions regarding 
jobs described on the precec^ing pages: how tnany Individuals are employed in 
described position; how many of these employees were hired for new openings 
in the last two years; and what is the outlook for openings in the next two 

years. Responses ^re summarized in Table VIII. 

TABLE VIII 

EMPLOYMENT OUTLOOK FCm DESCRIBED POSITIONS 
AS REPORTED BY PARTICIPATING EMPLOYERS 



Occupational 
Programs 


Current Number 
Employed In 
Position 


New Employees 
Hired in Last 
Two Years 


Outlook For 
Openings 
Next Two Years 
All Programs* 


New Openings 
7o Increase 


Computer Science/ 
Keypunch Operator 
(4 interviews) 


15 


13 


16.5 


111% 


Early Childhood 

Education 
(4 interviews) 


33 Part-Time 
16 Full-Tlme 


6 Full-Tlme 


2 Full-Tirae 


6% 


Log Truck Driving 
(1 interview) 


20 

25 Seasonal 


12 


Nonii 


0% 



N=12 questionnaires (9 Interviewed; 4 written) 

♦Comments from employers that outlook depends on funding and econooilc condicions. 



Employers were asked for an opinion regarding the occupational training 
at the college. This open-ended question was categorized into four areas in 
Table IX. 
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TABLE IX 

MAJOR STRENCJTHS • OF OCCUPATIONAL TRAINING 
AS SEEN BY PARTICIPATING EMPLOYERS 





Occupational Programs 


Response 
Categories 


I 

Computer/ 
Keypunch 


Early 
Childhood 
Education 


Log Truck 
Driving 


Totals 


Field Work Experience 


2 


2 




4 


Technical/Theorical 


1 


1 


2 


4 


Availability of Training 


1 






1 


Employer Could Not 
Answer Since Unaware 
cf College Prograii:g 


1 


1 




2 



N=ll 



Employers were also asked what they believed to be the greatest need 
for improvement in the occupational training provided by Shasta College. 
Responses fell inLo six areas listed in Table X. Employers, in most cases, 
described more than one area for irprovement. Table X also includes com- 
ments not classified. 
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TABLE X 

GREATEST NEED FOR IMPROVEMENT 
IN OCCUPATIONAL TRAINING AS SEEN 
BY PARTICIPATING EMPLOYERS 



Response 
Categories 


Occupational Programs 


Computer 
Science 


Early Childuood 
Education 


Log Truck 
Driving 


More Varied Practical 
Experience 


2 


1 




' Moi;e Intensive Training 
Skills and Theory 


2 


2 


) , 


Acquaint Student With 
Self-Development Needs 
(i.e., flexibility, 
self-expression, social 
interaction, profes- 
s ional appearance , job 
preparednean , public 
relations) 


1 


2 


i 

1 


Employer Couldn't Answer 
Since Unaware of Collegie 
Program 


2 






Comments : 


• Don' t graduate 
student for non- 
existent jobs 

• Keep college 
courses up to ~ 
tGchno logiciil 
chaages 


• Individualized 
Teaching 

•Discipline Tech- 
niques 

»Know more about 
private child 
care 

•More specific 
course content 


•Traffic Safety 
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Comments derived from asking the question^ "What are the most significant 
proposed changes in this occupational field?" Ind "Describe how job skills 
and educational requirements will change in the next five years and affect 
current and proposed positions?" are listed below. 



Occupational 
Programs 



Employer Comments 
On Proposed Changes 
In Occupational Field* 



Employer Comments on Proposed 
Changes in Job Skill And 
Educational Requirements* 



Computer Science/ 
Keypunch Operator 



Early Childhood 
Education 



Log Truck Driving 



» Fast-growing field. 

•Technological changes. (2) 

•Advent of micro computer. 

•More complex/ larger machines. 

■Change from "batch processing 
to data base processing." 

•Demand for personnel has 
leveled off. 

•Combining computer science 
with all disciplines. How 
can computer be used as 
everyday practical aide^ 

♦Concern about poor articula- 
tion between community 
colleges & 4"year colleges. 

•Concern that 4-year graduate 
will replacii 2-year in 
child care teacher posi- 
tions. "Differential staff- 
ing should be maintained." 

•Increase state education 
requirements . 

•Competition between private 
& public child care. 

• State & federal government 
incre^ising number of pub- 
licly-supported centers. 

•Individualized teaching. 

» Community becoming more 
aware of need to take 
stand for quality child 
care. 

•It will be increasingly 
necessary to haul loads 
further. May be inter- 
state. 

*KDre technical. 



• Keep up with & know new tech- 

nology. (3) 
,^Need "Super Operators" to 

supervise complex machines. 

• Shouldn't have too much ex- 

perience in batch proces- 
sing & outdated equipraent. 
(2) 

•Stress mini computers, Cobol, 
applications design (espe- 
cially in data base envir- 
onments) . 

•Educational requirements -In- 
creased (Children's Center 
& Title 22 proposed change^ 
(4) 

•Increased need for jpeciali 
zation in child development 
(preschool teachers & col 
lege instructors). 

•Courses should stress train 
ing in individualized 
teaching. 



*Number following comment indicates more than one employer responded. 



ERLC 



148 



L 

ANALYSIS OF FINDINGS 

Restatement of Problem 
The primary purpose of this project was to explore a method for gather- 
ing information from employers as a means of evaluating thi effectiveness of 
occupational training programs. 

Effectiveness of Method 
Selection of the student population using the criteria listed on page 
four proved to be an effective employer identification procedure. Colleges, 
of course, would need to have instituted the S.A.M- system in order to use 
this selection criteria. The initial returas from the S,A,M. follow-up plan 
may provide an insufficient sample of target jobs for employer follow-up, 
but use of the S.A^M. system should provide an adequate nxjmber after two 
years in most active occupational programs. 

Shasta College drew its population for the study from three occupational 
areas. Of these seventeen students identified from the returned follow-up 
questionnaires, sixteen employers were contacted and fifteen verified employ- 
ment of former students. 

Five days were needed for initial phone calls to arrange for interviews. 
Nine employers agreed to personal interviews. One employer refused to parti- 
cipate, saying it was doubtful whether the company could be of any help, 
especially since the student was employed by the company prior to enrollmenV 
in the occupational program. Two participants said they could not agree to 
an interview, but would complete the forms if mailed to them. Two other 
employers were mailed serond letters and questionnaires, since contact could 
not be made, it should he noted that eight of the nine employers consenting 
to personal interviews were in Comouter Scxence and Early Childhood Education. 
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Supervisors in both these fields could be considered to have "desk jobs" and 
therefore could schedule appointments more easily. There was only one truck- 
ing firm that consented to an interview. Follow-up coordinators need to con- 
sider the type of occupation in deciding to hold personal interviews or to 
obtain data through the mail. 

The general response of employers contacted by i-nvone and personal inter- 
view was positive. Upon initial contact, several employers expressed concern 
about responding, since they did net feel sufficiently fami^liar with the col- 
lege program to evaluate it. Most employers said that their responses could 
only be based on the performance of the former students. 

The S.A.M. consortium meeting report, December 1975, mentioned difficulty 
in getting meaningful responses from employers as an important reason why * 
employer follow-up was not pursued. A field-tested, standardized interv^iew 
form should alleviate this problem. The question also arises whether the pro- 
ject should use a college staff member or an outside interviewei:. Again, the 
employment of a standardized interview form eliminates the need for either of 
the above. Interviews are time requiring; hiring of an cutside interviewer or 
using staff meinbers could make employer follow-up financially impossible. 
There are two good resources available in work experience students majoring 
in the occupational area being investigated as part of their work experience 
requirement, and student workers and work-study students needing positions. 
These students, already having training and knov/ledge in the field, would 
need only orientation to interview methods and to the project. This might 
also provide these students with a realistic look at their career choice. 

Perceptions of corariunity college occupational training programs were 
generally favorable among those interv:'.ewed. Some of the positive comments 
included the following: n 
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"Think alot of program out there . . . impressed with attitud-;^ 
that others have for courses.'' 

"Judging program by fomer student • • satisfied." 

"Two-year colleges are doing a terrific job - everyone agrees." 

"We want to give more input to programs." 

"Keep up the good work." 

Responses received from participating employers varied with the amploy- 
ers' awareness of community colleges, their occupational field, available 
time and position. 

Review of Instruments 

There were three standard forms used in this project: S.A.M. Follow-Up 
Questionnaire (Appendix, page 1) ; preliminary questionnaire (Appendix, page 7); 
and standardized interview of employers (Appendix, page 9). 

The follow-up questionnaire asked the former students to answer items 
for the S.A.M. project. Additional items were required for the employer follow 
up study. There were: employers* addresses; name and title of supervisors 
or contact persons; and student's current job title. 

Although it is important to keep the preliminary questionnaire short, 
there are additional questions that could be added. Since information ob- 
tained from question two of the prel.'minaiy questionnaire can't be categor- 
ized, question two should be changed to a checklist of other specific and non- 
akill requirements. Some identified by employers interviewed in this study 
included: 

1. Experience 

2. Supervisory skills 

3. Personal presentation 
4* . Mathematical skills 

5. Initiative ^ ^ 
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Question tbret* yielded little usable data, and therefore should be elimi- 
nated. 

WViichever skills and non-skill requirements are added to question two 
should be listed for rating in question four on a revised questionnaire, 

ince employers were asked in question seven to check the importance of 
collage^ training in relation to other qualifications, the employer might also 
be asked to list the other qualifications and minimum reqxiirements for the 
position. 

An explanation is required to clarify the the Yes /No responses in ques- 
tion eight. 

Items A - G on the standardized interview form ask for factual informa- 
tion which requires at least twenty minutes to answer during a standardized 
interview. In some cases, employers needed to look up the information. It 
would seem to be a more efficient use of time to ask items A - G on the pre- 
liminary questionnaire. Many of these positions have written job descriptions 
which could be' provided. Also, at this time additional job descriptions of 
related or proposed jobs could be requested. 

The interviewer should still have the employer verify the exact job 
title at the time of the personal interview. On Interview Item G, the 
employer should be questioned about the total number of new employees hJred 
tn the last two years. 

The open-ended questions in Part II, Employer Opinion, allowed for a 
more detailed, complete discussion of the work situation and came at a time 
during the interview when the employer was more fully informed and relaxed. 
The responses to the questions were therefore more fruitful in understanding 
the work situation. 
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The preceding section describes modification to instruments. Overall, 
data collected could be tabulated and quantified for statewide comparison. 

Staffing Review 

A cost time analysis for this ^levelopmental employer follow-up project 
is estima'^ed below: -i-^ 





TASK 


HOURS 


1. 


Proposal 


6 


2. 


Instrtunent Development 


24 


3. 


Phone Calls 


10 


4. 


Interviews 


18 


5. 


Follow-Up Letters 


10 


6. 


Trave 1 


18 


7. 


Clerica" 


24 


8. 


Report 


80 




Total Hours: 


190 



ACTION 

This report is being submitted for review in June with the three other 
studies on Employer Follow-Up, 

Since there is specific data that would be of interest to the three occu 
pational areas being investigated, reports will also be made available to 
college staff. It is also believed that the advisory committees of th: :-.e 
occupational programs will be asked to review the findings and to make recom- 
mendations and commentis regarding the report. 
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RECOMMENDATIONS FOR DESIGN 
OF FUTURE EMPLOYER FOLLOW-UP 

Five recommendations are offered, based on findings of this study, for 

design of future employer follow-up studies: 

1. It is recommended that changes suggested in the section 
Reviewing the Instruments be considered for incorpora- 
tion into future follow-?Jip questionnaires, 

2, It is recommended that personal interviews be held with 
employers when possible, since more relevant information 
is gathered thaii through mailed questionnaires. 



3. It is recommended that project directors employ those 

college work-study students and student workers majoring 
in the occupational programs being evaluated. If there 
are no funds available to employ interviewers, students' 
taking work experience might conduct interviews, using 
the standardized interview form, as part of their work 
experience course assignment. These students y it is be- 
lieved, have identified a specific interest in the occu- 
pational training pr^^ram, and would be enthusiastic 
about gathering exact employer information regarding 
their career selection. An additional component could 
have these students interview the former students, 

: 4;" Tc is recommended that initial personal interviews be 
conducted by other than college staff, and that staff 
follow up with additional interviews when the program 
could benefit from more specific questioning of the em- 
ployer and when time allows, 

5, It is recommended that priority for employer follow-up 
studies be given to those occupational programs which: 
a) have a low student emplojmient placement; b) are newly 
initiated; or c) are undergoing rapid technical chang,e, 

6. It is recommended that individual departments or divi- 
sions utilize the available employer follow-up models 
as a guide in evaluating individual programs when a 
large scale project is not warranted due to lack of funds 
or limited student follow-up population, 

SUMMARY 

This report defines a method for evaluating the effectiveness occupational 
training programs through employer follow-up. Findings outlined for Shasta 
College need to be reviewed by departmental staff before exact impact on college 
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,.o,r^ c.n P.03ect.d. The conclusion i. da., .e,ul«d for ev.lu.- 

.ion can be obtained fro. employers of fo^er student, to aid in i^provin^ 
occupational training at co»nunity colleges. 
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A-1 



S.A.Mr- FOLLOW-UP 
STUDEInT QUESTIOtJNMRE 



Maine Present AdJrcss 

Telephone Number Social Security Number 

What was your first job ailer leaving Shasta College? ^^^=.^=^=_ 

Who was your first cm ploy or? ; 

PLEASE ANSWER 'HiE FOLLOWING QUKSTIONS RELATING TO YOUR PRESENT JOB. 

What is your present job? 

Who is your present employer? 

Do you work full time ? Or part time? 

Do you work day shU't? Swing shilt? Graveyard? . Other? 

I low many hours per week do you work? ^ 

What is your hourly rate of pay? ; ^What is your monthly rate of pay? 

How long hcve^you held this job?^ • ; ^ ' 

Mow has yoi^r college training helped you ic youi' present job: to get tlie 3ob^__^ 

to earn a promotion ? other? . _ 

(please explain) 

Were you giveu help by the Placement Office or the instructional staff of the college in seeking 
your first job? 

Yes No Please explain. I 

Are you satisfied with your present employment? 

Yes No Please explain. \ 

We would like to have you rate various aspects of your college experience as it rela;^;* t ' your 
present work. (Please check the appropriate coluinu. ) 

Excellent Gcod Acceptable Poor 

a. College instiuctlonal piogram | 

b. Training facilities G equipment 

c. College work experience program 

d. College counseling services 

Which course or courses Uken while in college have been mosc helpful to you in your work? 
Explain.^ ^ 

What additional training or skilL would have been moit useful for you tc dtvciop? Explain, 



Comments: Please provide any infoiTnation about yourself, or the college, which you feel would 
be helpful to us in improving our occupational programs. 



• SEMESTER Jfg 
^Qsttucclcaal Dhrisiom Business Sducatlon 
btf^ctional Program: . Computer Science (320) 

14020300 U>S.O,E. Code 
C.I.D- Code 



Stadcnts CoaUctcd:__12- 
Qucstionnaircs Rcturncd:_9j[ 




1, Prettcsploymcnt 
ObjectiYC 



2. College Transfer 
Objective 



3, In- Service Training 
Objective 



4. High. School Diploma. 
Objective 



5« Ccner?! Education 
Objectr/e 



jStttdeat Program Ratings: 

College instructional program 
Training facilities and equipment 
College work experience program 
College couaseliflg services 



2 V 














2 


















3 








1 


















i 














t 








44% 


11% 11% 34%- 



Excellent Good Acceptable Poor 




Salary Rsnge 
Jobs Related to 
Occupational Major 










Hr: 
Mo: 










Low 












$2.56 
$450 


$4.25 
$1000 











S v.m.najv CoTnTTicnts: Although this program is described as an occupational program, 6 of 

the 9 students returning questionnaires (67%) indicated that they either were or inr 

tended to take further training at a four-year college; however. 5 of the 9 students 
contacted (55%) were working at computer-related jobs. 
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• SEMESTER Spring 1975 
Instiuctiooal Division: Business Education 
Instructional Program: Keypunch Operator ^634) 

14020201 b.S.O.E. Code 
CUD. Code 



A-3 , 

Questionnaires Mailed:_lQ. 
Students Contacted: 9_ 



Questionnaires Rctumed:_2jC227o) 



Trccm ploym ent 
Objective 



College Tjfzijfer 
Objective 



3« In-Service Training 
Objective 



4» HI3I1 ScLooL Diploma 
Objective 



5* General Etfucation 
Objective 




50% 

Student RrosraJn Ratings; 

College instructional program 
Training facilities and equipment 
College work experience program 
College counseling services 



50% 



50% 



Excellent Good Acceptable Poor 




Salary Range 
jobs Related to 
Occupational Malot 










Hr: 
Mo: 










Low 


High 










$ 


$525 











Summary Comncnts; A very low return rate was experienced in this certificate program 
(22%). The primary difficulty in surveying this occupational program was the fact 
that most students did not see their enrollment in the course as a specific occupa- 
tional program but as an adjunct to a secretarial or computer science specialization. 
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■ SEMESTER Spring 1975 
rlnstmctional Division: Applied Sciences 
j Instnictioaal Program: Early Childhood Education (416) 
^ 09010200 ' U.S.O.F. Code 



A-4 

Qucrtionnat'Ts Mailed: 6_ 

Students Coixta;-:tcd: 6 



Questionnaires Returned ; H nn %) 




I* Preemplo/xnent 
Objective 



2» College Transfer 
Objective 



3» In-Service Training 
Objective 



4. High School Diploaia 
Objective 



5* General Education 
: Objective 



Student Rrograna Ratings; 

College instructional program 
Training facilities and equipment 
College work experience program 
College counseling services 



Excellent Good Acceptable Poor 















c 

J 




1 






1 


















































i 










83% 







Salar/ Range 
Jobs Related to 



Low 


High 


$2.00 
#325 


$3.00 

$480 



Summary Comments: Six Students were identified who left the College after completing 
courses In Early Childhood EdtfSTtlion. All the students returned the questionnaire 
Five of the six students were employed in a job related to their college training " 
The remaining student was a housewife who was not seeking work outside, rhe home 



100% 



160 



ERIC 



SEMESTER Spring 1975 
ttisUiiction.ll Otvisioo: Trade/Industrial Education 
Instructional Program: Log Truck Driving (656) 

17990000 U.S.O.E. Code 
C.I,D. Code 



A-5 

Questionnaires Ntailcd:. 
Students Contictedt 



26 



23 



Questionnaires Rotumcd ; 13(57 % 



1. Pt.:?cinployxient 
Objcctr/c 



2. College Transfer 
Objectr/'e 



3.^In-Scr/icc Training 
Objcctr/e 



4« IlisL school. Diploma 
Objective 



S« Cencrol Education 
Objective 




■ * 52»% 






23% 


8% • 




13% 


Student Program Ratin?:s: 


Excellent 


Good 


Acceptable 


Poor 




Salary Range 
Jobs Related to 


CoHcsc instructjonal program 




X 








Occupational Ma^or 


Training facilities and equipTtsent 


X 










Low 


High 


Co lies 4i v;ork experience program 




X 






Hr; 


$3.00 


$6.88 


Collcg'^ counseling services 




X 






Mo 


$480 


$1100 



Siiir ary ComTncnts: 



Thirteen of the 23 students completing f.be. log truck driving course 

and leaving the College in the spring of 1975 were contacted. Only 2 of the 13 were 
unemployed and seeking employment as a log truck driver. Seven of those contacted 



(54%) were initially employed as truck drivers, but not aU were employed specif i 
cally as log truck drivers. All elements of the program received high ratings by 
students. 
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DALE A. MILLEA 

Otstfict Superintendent President 



Shasta College 
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President 

Dr Cha''lcs D. MiJU r. RfiddiDg 

Vice President 
Mr James R. Stack wood. Red Bluft 

Ckri 

Mf Thomas J. Luddfn> Weavrn/iMf 



Mr Edward J. Dutro, T^hamc 
Mf B. AWan Jones, Fall Rivor MJIti 

Mr. Joseph H. Redmon, Rcddf^- 
t/ir. Rot land S. Robinson, CoifonAOo: 



Project S.A.M. 

Student Accountability Model 
Re: 



Dear Colleague: 

Shasta College is working to improve its occupational training program. 
You can help us greatly in this effort. 

According to. our records, the former Shasta College student named above 
is currently employed by your organization. This project is not evalu- 
ating the individual performance of this student, but we are, instead, 
concerned about how effectively our training program prepares all students 
for employment. -> 

To assist us in evaluating the cf ^ictiveness of our program, would you 
agree to a short interview v/ith a representative from the college during 
the f^'onth of April? You wjll be ccntacted by^phone to arrange an inter- 
view date/ ^ Enclosed please tTnH^a pireTinn questionnaire we ask that 
you complete. This questionnaire will assist us in evaluating our 
occupational programs. 

Your cooperation will go far to help us make our programs more effective. 



Sincerely, 




Associate Dean of Student 
Assistant Services 



cr 

Enclosure 
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SHASTA TEHAMA TRINITY JOINT COMMUNITY COLLEGE DISTRICT 
•.orr. »<nc.Tu ni n r.npnnfj TRAti • REO0t^*(; CALirORNIA 96001 • TFLLPHONE (916) 241 3523 



SHASTA COLLEGE Dace 
PROJECT S.A.M. 
STUDENT ACCOUNTABILITY MODEL 
EMPLOYER FOLLOW-UP 

Preliminary Questionnaire 



■Please -complete this questionnaire, keeping In mind that we are not evaluating 
the individual performance of your employee, but we are concerned about how 
effectively our training program prepares all sti'dents for employment. Check 
only one response for each question. A college representative will pick up this 
questionnaire at the time of the interview. ^ 





/I 

09 
Uj 


ou. / 


Please identify v/hich of the fol- i 
lowing '^are essential or non- 
essential to this jotrin your 
organization : 

a. Technical Knowledge 






b. Operation of Equipment 






c. Writing Skills 






d. Verbal Communication 






e. Interpersonal Employee 
Relations 







Are there other specific skills essential for the job? Yes No 



If yes is checked, please list: a. 

b. 
c. 



How would ypu rate the overall 
effectiveness of the technical 
training provided by our college? 
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Employer 



Interviewer 



SHASTA COLLEGE 
S.A.M. EMPLOYER FOlLOW-UP 
STANDARDIZED INTERVIEW OF EMPLOYER 



Date 



Time 



to 



Job Positions 

A* According to my information, 

has listed his/her job title . 

B. Could you describe or provide the duties and responsibilities of this position: 



C. V/hat is the pay range: • 

D- What are the benefits: 

E. Minimum educational and experience requirements are: 



F. Opportunities anjJ^equirements for promotion for individuals in this position 
are: 




G. Kow many are employed in this position: 
Number employed in the last two year^: 



Outlook for new openings in the next two years: 



H. What other related positions/jobs are available in your organization: 



(This section will be followed up with a written request for duties/responsi- 
bilities; pay range; benefits; and education/experience.) 



Preliminary Interview (Continued) 



4, How would you rate 'the effective- 
ness of our college training for 
each of these: 

a. Technical Knowledge 



b. Operation of Equipment 

c. Writing Skills 



d. Verbal Communication 



e. Computation Skills 



f . Interpersonal Employee 

Relations 

How would you rate the effective- 
ness of our programs in preparing 
individuals for pre-employment 
procedures? (i.e., the interview, 
the application, personal presen- 
tation) 

How would you rate the effective- 
ness of our programs in orienting 
individuals to employment? (i.e., 
v/ork attitude, attendance, cooper- 
ation with co-v;orkers and with 
management) 



i 
1 


Good 


i 




1 





































































































7. How important is college occupa- 
tional training in relation to 
other qualifications you consider 
in making the hiring decision? 

8. Would you hire one of our gradu- 
ates for a future job in your 
organization? 

9- Would you like a copy of the 
completed survey? 




Yes_ 
Yes 



No 



No 



165 



A-;.i; 



S.A.M. EMPLOYER FOLLOW-UP 
RATED QUESTIONS 



II. Employer Opinion 



A. What, in your opinion, is the major strength of the odcupational training 
provided by Shasta College? \ 



B. What, in your opinion, is the greatest need for improvement in the occupa- 
tional training provided by Shasta College? 



C* What are the most significant proposed changes in this occupational field? 



D. Describe how job skills and educational requirements will change in the 
next five years and affect current and proposed positions? 



E. What additional comments or suggestion.* do you have for Shasta Collegers 
occupational traii»;ng programs? 




EKLC 
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Shasta College 



. A-11 

BOARD OF TRUSTEES 

Preiident 
Or. Charles 0. MiUer. Reddinc 

Vice Preiident 
Dr. Donald L. Hair is. Corninc 

Clerk 

Mr. Thomas J. Ludden, Weaver^ 



DALE A. k'.;.L6R 

District Supcrlntendint-Prtiident J^"^" B»«ck«'''o<l. « 

Mr. 6. Allan Jones. Bufney 

FOUN'^ED 194S 

Mr. Joseph Redmon, Redding 
Mr. Rolland Robinson. Couonw( 

Project S.A.M. 

Student Accountability Model 
Re: 



Dear 

Please refer to the previous letter sent to you from Shasta College 
regarding your assistance in the evaluation of our occupational pro- 
gram. We indicated that you would be contacted by phone to arrange 

for a personal interview to gather information about the 

program at the College. We have attempted many times to make these 
arrangements. 

Since the project deadline is approaching, I would like to ask if 
the person supervising the former Shasta College student named above 
would be willing to complete the interview form. As indicated before, 
this project is not evaluating the individual performance of this 
student, but^we are concerned about how effectively our training pro- . 
gram prepares all students for employment. 

Enclosed please find a copy of the Preliminary Questionnaire which 
was sent out with the initial letter and a Standardized Interview 
form. It would be greatly appreciated if both these forms could be 
completed and returned as soon as possible in the stamped, self- 
addressed envelope. Your assistance and expertise is certainly needed. 

Again, your time is truly appreciated. Thank you for your cooperation. 
Sincerely, 
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SHASTA-THHAMA TBINITY JOINT COMMUNITY COLLEGE OlSTBICT 
106S NORTH OLD OREGON TRAIL . REDOING, CALIFORNIA 96001 • TELEPHONE i«J»8) 241-3S23 



BOARD OF TRUSTEES 

Pretidcnl 
Dr. Charles D. Mtiler. Redding 

Vice President 
Dr. Donald L. Horns. Corning 

Clerk 

Mr. Thomas J. Ludden. \.Vc3vcrville 

)ALE A. MILLER 

Nttfict Sup«rinttndem.Prtiid«nt Mr. James R. Blackwood. Red Blu(f 

FOUNDED tfljs ^ Allan Jones. Burney 

Mr. Joseph Redmon. Redding 
Mr. Rolland Robinson. Coitcnwood 



SMsta College 



Dear 

Please accept a word of appreciation for the time you gave to 

assist Shasta College in the evaluation of the 

program. 

The personal interview provided many interesting and informa- 
tive insights. Your cooperation makes it possible for Shasta 
College to make our training programs more effective. 

Sincerely, 



EKLC 



168 



SMASTA TEHAMA TRINITY JDINT COMMUNITY COLLEGE DISTRICT 
106S NORTH OLD OREGON TRAIL • REDDING. CALIFORNIA (^6001 • TELEPHONE (916) 241^23 



Shasta College 



A- 13 

BOARD OF TRUSTEES 

President 

Oi Chart*';. D Mill*;', Rtdd»r 

Vice Prpiidcnt 
Df DonjM L. H.iiti«. Cuin»» 

CIcik 

M« Thomas J l.«J(li|i-t\ VVea/c 



GALEA. MILLER 

District Sup«rintendent-Pretidcnt Mr. Jarries R. BlufW..jw(J. Rod 

FOUNDED W48 8. Aiian Jo.^.s. Uumey 

Mr Jo&epii Refiriiun. Mtrioiii 
Mr. Rollanri Robuison. Costonif 



Dear: 

Please accept a word of appreciation for the time you gave 

to assist Shasta College in the evaluation of the 

program. 

Your cooperation makes it possible for Shasta College to 
make our training programs more effective. 

Sincerely, 



ERLC 
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SHASTA TF.HAMA.TRINITY JOINT COMMUNITY COLLEGE DISTRICT 
1065 NORTH OLD OREGOh TRAIL • REDDING, CALIFORNIA 96001 • TELEPHONE (91GI ?41.3523 



Appendix G 



SAMPLE COLLEGES SURVEYED FOR EMPLOYER 
FOLLOW-UP INFORMATION BASE (Stratified by 
size and geographical representation) 

NORTH SOUTH 



American River (Los Rios District) 

Fresno City (State Center District) 

Modesto (Yosemite District) 

City College of San Francisco and Centers 
(San Francisco District) 


FuUerton (North Orange County District ) 
Long Beach City (Long Beach District) 
Pasadena City (Pasadena Area District) 


Merritt College (Peralta District) 
• 


Citrus College (Citrus District) 

Cypress College (North Orange County 
District) 

Orange Coast College (Coast Community, 
District) 

San Diego City College (San Diego District) 


Cabrillo College (Cabrillo District) 


Grossmont College (Grossmont District) 
San Diego Mesa (San Diego District) 


Consumnes River College (Los Rios 
District) 

O ^ 


San Diego Miramar (San Diego District) 



Appendix H 

Project SAM 
Employer Follow-up 



Abstract of Survey Interviews with a Representative Sample of 
California Community Colleges 

Objectives of the interviews were to determine: 

1, Experiences of the district/college with employe J follow-up, 

2. What the district /college needs to know from employers to 
review and evaluate occupational education programs. 



Introduction - 

During November and December, 1975, project staff interviewed com- 
munity college personnel to provide the Employer Follow-up Project 
with an information base of local experiences and attitudes toward 
employer feedback. Twelve community college districts representing 
eighteen colleges were contacted. 

The sample colleges selected fell into four cells based on size 
(occupational education enrollment) anO Included northern and south- 
ern California districts in each cell. 

Advance contact was made with the district college chief occu- 
pational education administrator to r:.^^-:cvtbr.. the intent of the inter- 
view and kinds of information being "^r/jg^'o.t . nd to suggest other 
college personnel who might participant e ^he discussion. Reception 
was positive and colleges/districts provvcec excellent information 
that served as valuable input for ti o sysf design and for discus- 
sion information by the Employer Fol Io-a • Consortium. 

To achieve consistency in data, an ir '.rument was used to guide 
discussion and record comments. The Instrument was st 'uctured in 
two parts consistent with tho objectives t 

A* Experiences of College /District with Employer •ollt ;->Jp, anf' 

B. Information Needed from Employers for Program Evaluation and 
Rv3view. 

The district was also asked to identify any persons at the dis- 
trict or college who might contribute to the project and asked 
sp' J^fically if thev would be interested in participating in an 
employer Tollow-up field test^ The following comments summarize 
dist rict expex iences . 

Sxperi -..' nces of Colleges/Districts with Eip - lover Follow-up 

1. Met of the colleges interviewed used no systematic approach 
to collect, analyze, and disseminate employer perceptions of 
:tccupational training programs. 
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Appendix ^ continued 



2. Reasons given for not using a systematic approach to 
employer follow-up included! staffirig,, financial, and time 
constraints; lack of a system for acrauiylishing; lack of 
accurate identification of employers of former students; 
difficulty of getting meaningful res;x)nse from employers; no 
considered to be a high priority accl^ity? developmental 
stages of related^ programs /services such as placement and 
work experience. 

3. A variety of techniques, methods, n^rA operations are used to 
get information from employers for v-^ry specific purposes, 
e.g. placement , CWE student supervision # needs assessment . 
Formal and/or informal approaches lacludedi 



a) Use of a specially hired ^nd r:rained incerviewer to 
contact employers » 

b) Use of advisory committees. 

c) Instructor contacts, varying from formal approach 
with release time provided to rnore casual and informal. 

d) CWE coordinator visits. 

e) Placement depertment cont:accs« 

f) Program coordinator/instructor inc;.e^>th surveys. 

g) Seminars, forums, job fairs ^ etc. 

h) . surveys in collaboration with professional or trade 

organizations, e.g. San Gabriel Valley Dental Society/ 
tricollege survey regarding Jc-ntal auxiliary. 



4. Colleges have found that employer contacts are generally 
favorably received. However ^ ge^^-cing to the right (most 
knowledgeable) person to gain Vcilid information is not a 
simple task. They also believe it is important to show value 
for: the employer of a follow-v;p system if the* reception is to 
be positive. 

5. Colleges expressed concern about the obstacle the "right to 
privacy" legislation was to their efforts to track students. 

6. Contact Method i Mail, telephone, personal call, all have been 
used to contact employers. Any contact method must be simple, 
brief, easily administered, and economically feasible. A 
blend of several methods could conceivably be employed. Qual- 
ity ol response is far more important than numbers of respon- 
dents . 

The labor market trained for, too, poses problems because of 
th'? niobility of students. Local contacts are generally easier. 

Varying sizes of employer organizations and number and fre- 
quency of hirings are also conditions that must be addressed. 

7. The contact person (e.g. personnel department, immediate 
supervisor) is a variable depending ont 



a) 
b) 
c) 



Information sought 
Company policies 

Known facts about the former student, i.e. reporting 
relationships. 



ERLC 
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Appendix continued 

8. Contacr- timing should be long enough after employment for 
-some demonstration of expertise and yet not so long that 
college tr^lntiig; and on-the-job training are not easily 
distingui'^r:??d. Generally this translated into no sooner 
than three 'rionlhs, and no longer than one year, with six 
months being a fairly "middle ground" consensus, A single 
contact (i.e. between three months and one year) was con- 
sidered sufficient by most districts. 

B. Information Needed from Employers for Program Evaluation and 

Review 

Colleges /districts were asked to rate the importance to pro- 
gram evaluation of a variety of information that might be 
obtained by employers. A three point scale of essential , mod- 
erately important , and not essential was used. 

Items were grouped into categories i hiring information, per- 
sonal skills, technical skills, and employment potential. 
Colleges weret also asked about instrximent design and format, 
. i.e. selected items and rating scale and /or open-end questions. 

1. Input related to the value and quality of Technical training 
was agreed to as being of greatest importance. 

This should be approached in two ways» 

a) Specific items related to a particular job and a 
rating scale and a solicitation of open-end re- 
sponses on program strengths and needs , or program 
training deficiencies or lacks. 

b) Questions should address skills and not "attitudinal" 
areas.. 

2. Questions or items addressing personal skills (work orienta- 
tion, initiative and responsibility, cooperation) met with 
varying receptiveness. Some colleges felt it was essential 
to determine if personal skills were the major deterrant to 
success, others believed it was not an area which a college 
had much opportunity to influence and/or change. A majority 
of colleges favored including one question related to work 
orientation. 

3. Influence of the college training on the employers hiring 
decision was generally felt to be an appropr^ nt-^ area on 
which to get feedback. Effectiveness of trair..rv' in "pre- 
employment" skills (interview, application, sexj. presenta- 

. tion) drew extreme reactions (very pro and very against). 
Those that favored employer input in this area felt it would 
have real impact on program design. 

4. Employment potential as a result of college training and ^ 
whether the college trained employee had better opportunities 
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Ap pend i x ^ H-conulnued"^ " 
A. continued 

than the non-trained employee drew mixed reactions. Reasons 
for these reactions were that these were subjective areas, 
that input would not directly influence training programs, 
and that it was an "ego buiHing" question for the college. 

5. Although colleges sampled all feel tha. forecasting and 
manpower projection information-, indications for needed re- 
training and upgrade programs, and new training or programs 
the college should become involved with are important inputs 
from employers , many did not believe this was the right 
vehicle for getting this information. 

6. A general (addressing all occupat i uns ) questionnaire although 
an acceptable starting place - will not have good acceptabil- 
ity or gather specific information needed for program review. 
It was believed that instruments for clusters and, in some 
instances, even for specific occupations will eventually need 
to be developed. 

C. Colleges in general believe there is real need for a system of 
Employer follow-up) Such a system should be implemented locally 
and should be flexible enough to adapt to varying needs, interest, 
and programs including support services such as placement that 
should be linked with the system* Most colleges also indicated 
their willingness to participate in a field test of a system as 
long as it didn't require additional personnel, extensive budget, 
or excessive time from existing staff. Colleges generally in- 
dicated they would be very receptive to having their advisory 
committees react to any preliminary system developments and 
provide their input for refinement. 

D. Additional Comments 

1. The need for a signed release from the former student ai.itho- 
rizing contact with the employer or other such system to 
comply with legal right to privacy restrictions was empha- 
sized. 

2. Any system, regardless of contact method used, must have 
computerizat ion capabilities . 

3. Personal contact, in some form, was viewed by many colleges 
as an essential part of the system. This might be introduced 
prior to mailing an instrument, as an interview approach to 
getting feedback, or as enrichment to expand information on 

a mailed return. 
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Appendix I 



PROJECT Sam. employer FOLLOW-UP FIELD TEST PROCEDURES 



INTRODUCTION 

The Employer Follow-up Project objective is to develop a system to collect 
employer feedback on community college occupational education training 
programs, as can be noted on the attached sheet defining the objective and some 
of the conditions to be accommodated. The project is a spinoff from SAM 
(Student Accountability Model). Field test participation relies heavily on the 
participating collegers progress in implementing overall SAM. Information 
collected from employers should assist the college in modifying, and/or changing 
occupational programs. In other words, the system is designed to be program 
orientated, not personal performance orientated. With these thoughts in mind the 
following guidelines are defined as a part of the field test procedures. 

PLAN 

In cooperation with the project coordinator, each field test college will prepare an 
overall plan of their approach to employer foliow-up (See plan outline attached). 

The project provides for some financial support for a participating college for the 
field test. That is why the budget information is essential. Since the field test 
also is designed to be somewhat experimental in terms of the approaches used, the 
procedures, and the general system, it is hoped that among the test colleges there 
will be some variety in the application. The collegers plan should first service the 
needs of the college itself; and second service the needs of the project. 

EMPLOYER IDENTIFICATION 

To participate in the Employer Follow-up field test, the college must have 
specific information on the employer including the contact person and the address. 
The most effective way of collecting this information will htve been for thr 
college to already have gathered it through SAM student follow-up. 

If the student questionnaire included a question regarding the employer, this will 
be the easiest way to identify the universe, or the contact list. The "universe" for 
this project will include only those employers who have employed former students 
from the college. It also may be very important to have the students permission 
to contact the employer. A waiver, i.e., a question in the Student Follow-up 
Questionnaire asking if the student objects to having a contact made with his 
employer, should alleviate the "right to privacy" concerns. 

Colleges which have not identified employers through the student questionnaire 
will need to utilize other information sources, i.e., placement office or instructor 
lists, to identify the universe. 

The college may wish to follow^-up employers of all occupational education 
students, or may wish tc narrow the universe to a particular cluster, or a specific 
program. 
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PROJECT SAM, EMPLOYER FOLLOW-UP FIELD TEST PROCEDURES (Continued) 



INSTRUMENT 

The suggested instrument is a guide only. It was developed from information 
gathered through a survey of a representative sample of California community 
colleges, discussions with the project Consortium (which includes community 
college and industry representatives), and a search of similar projects in and 
outside the state. There is no known absolute best approach to an employer 
questionnaire or instrument. The college is encouraged to make changes that can 
best accommodate its own program review needs. However, it is also hoped that 
some consistency in categories of information requested from employers will be 
maintained by all participating colleges. Major changes in the instrument should 
be discussed with project staff. ^ 

APPLICATION OPTIONS 

In order to provide information and data about the methodology that is most 
workable, a variety of application options are suggested. These are suggestions 
only. The college may wish to identify additional approaches of its own. These 
approaches should be included in the plan. Application methods should be 
carefully analyzed and controlled so thu. there is hard data to support decisions 
made at the end of the test about which option, or approach, provides the best 
quality of employer follow-information. Suggested options include: 



A. 



Mail questionnaire only. 



C. 



Prior telephone call to inform the employer that a 
questionnaire will be mailed. 

Mail questionnaire with telephone follow-up: 



1. With 100% of the employers responding. 



D. 



2. With a sample of employers responding. 
Mail questionnaire with personal interview follow-up: 
1. With 100% of the employers responding. 



2. With a sample of the employers responding. 



E. 



Telephone interview only. 



Personal interview only. 



G. 



Other system of choice (to be specified). 
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PROJECT SAM, EMPLOYER FOLLOW-UP FIELD TEST PROCEDURES (Continued) 



TABULATION AND ANALYSIS OF INFORMATION 



Since the ultimate objective of the Employer Follow-up Project is to collect 
information that can assist in program modification, the analysis of responses 
from employers is of utmost importance. The college's plan should include a 
desicpiption of the approach to tabulation and analysis of survey results and 
specific information that indicates how program personnel will be provided with 
feecfcack from employers. 

DATES 

It is hoped that the field test will operate over a maximum of a two-month period, 
and that all data will be in and analyzed by May 15, 1976. 

TECHNICAL ASSISTANCE 

Technical assistance can be provided to the participating field test colleges by 
project staff, or through the use of consultants retained to provide a particular 
expertise. The college may request this in advance as a part of its plan, or, as 
they progress through the project. If a college experiences a particular problem 
whose solution is in the best interest of the project, every effort will be made to 
provide support help to the college. 
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Project SAN 



• OBJECTIVE 

Develop by July 1, 1976, a system for collectinf; fedback information 
from employers of community college occ,upatio;ia H'ucation completors. 

% commons 

The System must be: ^. 

i Compatible with SAM (Student Accountability Model) 

I Based on what community college educators need to km to assess, 
modify, and change programs and on what employers are willing 
to disclose. 

^ Guided by a consortium of employers and community college educators. 
• Monitored by the SAM Consortium 

t Flexible and simple for easy application to individual community college 
district needs 

t Tested and ready for implementation 

t DESIRED RESULTS 

Irn^ ^'^^ Improved quality of occupational education programs at California ^'^V 

community colleges. 



PROJECT SAM 
EMPLOYER FOLLOW-UP 



INSTRUCTIONS TO PARTICIPATING FIELD TEST COLLEGES 



The following information is suggested for inclusion in your college/district plan and 
report for the Employer Follow-up Field Test. Since the project objective is to develop 
a system for gaining employer feedback information ^hat can be used to modif/ and/or 
change community college occupational education programs, some consistency of data 
and findings is important to the outcome of the field tests. These should be completed 
in writing and submitted to the project coordinator. 

OUTLINE OF INFORMATION TO BE^NCLUDED IN THE FIELD TEST PLAN 
!• District Name, Address, and Contact Person (Name, Title, Telephone). 

2. Field Test Coordinator (s) (Name, Title, Telephone - if different from contact person). 

3. Participating Colleges (Name, Address, Telephone). 

4. College Coordinators for Field Test (Name, Address, Telephone - if additional 
persons involved) . 

5. . Description of Plan 

a. College Objective 

b. Method 

(1) . Identification of Employers. 

(2) . Occupational Programs Involved 

(3) . Sampling Techniques (if applicable) 

(4) . Contact Method (s) 

c. Personnel Assigned 

(1) . Instrument Design 

(2) . Employer Contact Coordination 

(3) . Data Analysis 

d. Time Schedule 

e. Budoet 

f. Requirements for Outside Assistance 

1 (1). Technical 

; (2). Budgetary 

g. Description of Data Analysis and Control 

(1). Tabulation Method (Manual, Machine) 

h. Dissemination Plans 

■ ■ ■ i 

OU TLINE OF INFORMATION TO BE INCLUDED IN THE FIELD TEST REPORT 

1. District and Participating College Identification Information (See #s 1. and 2. above).. 

2. Method 

3. Findings and Results 

4. Analysis of Findings. 

(a) . Approach 
y: (b) . Interpretation 

5. Action 

(a) . Dissemination ; 

(b) . Impact on College Programs (Actual or Planned Modification and Change). 
ERsJ^C 6. . Recommendations for. Design of Futui^^Employer Follow-up Activities. 
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SAM-EMPLOYER FOLLOW-UP SAMPLE QUESTIONNAIRE 



1 . Layout and Design - Top third of form is perforated for easy tear-off. 
This can be removed: 

a. By the Employer if mail contact only is made. 

b. By the Interviewer and handed to the employer for reference 
at the outset of the interview when a personal interview is the 
contact method. 

c. By the Interviewer OR Scheduler and mailed to confirm the 
appointment when a personal or telephone interview Is the 
contact method. 

The reverse side of this panel includes the employer's address and college 
logo and return address when the questionnaire is of the self-mailer design. 

2. Rated items are located on the middle third of the form both front and back 
for separation from open-end if this is more convenient for tabulating. The 
middle third also includes coded information the college needs for identifying 
the program, student profile, employer, and any other data that may be a 
desired outcome for the follow-up. Program and/or cluster professionals 
should be involved in identifying the categories of responses that might be 
desirable for thei r programs which would require coding. 

3. The lower third includes open-end questions to which the employer is asked 
to respond. As is noted above, this portion can be removed for tabulating 
or for disseminating to division or department chairpersons for input for 
their programs . 

The reverse side of the lower panel includes the college address for return 
mailing and space for address correction by the employer. It may be 
desirable to use envelopes rather than a self mailer. 

U. It is suggested that the form be typed and then reduced to an 8^" x 11" or 
8i" X 14" size for convenient handling. 



An example of this suggested format is attached. 
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Questionnaire Layout 
Emplo'^ r Follow-up 

(LIST OF STUDENT (S) EMPLOYED) 
(A Separate Form Should Be:Used 
for Eaqh Cluster orjProgram) 



(COLLEGE MESSAGE) 



PLEASE REMOVE BEFORE RETURNING 



(Coding 
Information) 



(Rated Questions) 



District 
College 
Cluster 
Program 
Student 
Sex 

SAM Class 

Ethnic 

Age 

Veteran 
Employer 
Job Title 



(OPEN END QUESTIONS) 
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Over PLEASE. 



(Employer Return) 

(Address Correction Requested) 

V 

-METEREb 

Return or S*.*wped 



(COLLEGE ADDREi ) 



(COLLEGE RETURN) 



ERIC 



(EMPLOYER ADDRESS) 
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SAM EMPLOYER FOLLOW-UP QUESTION^ AIRE COPY SUGGESTIONS 
(This information is to be read b>^or to the employer) 



TOP PANEL 
Left Side: 

According to the information provided by the person (s) involved, the individual (s) 
listed below are currently employed by your organization. Our interest is not 
in their personal performance on the job. ABC College is concerned about the 
job preparation training our coKege provides. 

NAME JOB TITLE OCCUPATIONAL PROGRAM 



Right Side: 

College Logo - PROJECT SAM (Student A. counMbility Model) 

ABC College is interested in finding out how employers feel about the occu- 
pational training our college provides. We also a^i< former students wh re 
now employed what they think. In fact, it. is the students who give us the employer s 
name and their permission to ask a few questions. The person (s) listed at the 
left.gave us your name. What we want to know is how our programs should '. 
changed or redirected to meet your needs. With you- input and th n - f. other 
employers and former students, we hope we will do a better job of preparing 
preserit and future students for their chosen occupations. 

Please take a few minutes to answer these questions. Additional comments and 
suggestions vyould be greatly appreciated. 

If you would like a copy of the completed survey, please check the appropriate 
box on the back of this fo» m. 



Th: I . you for your help! 
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SAM EMPLOYER FOLLGW-UP 



RATED QUESTIONS 

FRONT - Mid/jie Third 
Please specify job title (s) to which this 
information applies. 

TECHNICAL SKILLS 

How would you rate the overall effectiveness of 
the technical training provided by our college? 

Please identify which of the following are essen- 
tial or non-essential to this job in your organiza- 
tion. How would you rate the effectiveness of our 
college in training for each of these. Space has 
been provided for you to list and rate training in 
specific skills essential for the job. 



a. Technical Knowledge 

b. Operation of Equipment 

c. Writing Skills. 

d. Verbal Communication 

e. Computation Skills 

f. J 

g- . 

h. 

BACK - Middle Third 

How would you rate the effectiveness of our programs 

in preparing individuals for pre-employment procedures? 

(i.e., the interview, the application, personal presentation). 



How would you rate the effecti veness'of our programs in 
orienting individuals to employment? (i.e., work attitude, 
attendance, cooperation with co-workers and with managemen 



(0 
C 

tn 
tn 
LU 



c 

to 

(/) 
LU 
I 

C 

o 
z 



How important is college occupational training in relation 
to other qualifications you consider in making the hiring 
decision? 

Would you hire one of our graduates for a future job in 
your organization? 

Please send a copy of the completed survey. 



OPEN -END QUESTIONS 
FRONT - Lower Third 



What, in your opinion, is the major strength of the occupational training 
provided by ABC College? 



What, in your opinion, is the greatest need for improvement in the occupational 
training provided by ABC College? 



What additional comments or suggestions do you have for ABC College's 
occupational training programs? 



186 



Appendix J 

EMPLOYER FOLLOW-UP BIBLIOGRAPHY 

ERIC DOCUMENTS 
ABSTRACTS 

Baber, Lewis E» A Study of How Richmond Technical Institute Can Improve 
The Quality of Technical and Vocational Teaching with a More 
Defined Accountability Program and Possible Steps to Encourai, 
Educators to Be More Receptive to Accountability, U.S., Educational 
Resources Information Center, ERIC Document Resume. ED 
097 948, April 1974. 

Five-Johnson County Community College Institutional Studies: Part of 
the Self-study Process, 1973-74 . U.S., Educational Resources 
Information Center, ERIC Document Resume. ED 099 070, September 
1974. 

LaBelle, Beverly M. and Ellen C. Egan. Follow-up Studies in Nursing: 

A Case for Determining Whether Program Objectives Are Achieved. 
U.S., Educational Resources Information Center, ERIC Document 
Resume. ED 066 159, August 1972. 

Page, Charles and David C. Scott. Survey of Auto Mechanic Employers. 

U.S., Educational Resources Information Center, ERIC Document 
Resume. ED 101 815, February 1975. 
•» 

Rowell, James R. Needs Assessment Studies for Education. U. S., Educational 
Resources Information Center, ERIC Document Resume. Ed 
101 779, January 1975. 

Williams, William G. and Fred A. Snyder. Follow-up Studies of Former 

Occupational-Technical Students at Community Colleges. Research * 
Report Number One. U. S., Educational Resources Information 
Center, ERIC Document Resume, ED 104 499, 1974. 

' J i ^ 1 

REPORTS j i r 

Cell,. Robert R. and Suzanne C. Harkness. The Ejnployers. A Survey of 

Employers Who Have Hired Montgomery College Graduates. U.S., ^' 
Educational Resources Center, ERIC Document, ED 097-927, 
1974. . 

Konrad, Abram G. " And Rose Of f Madly in All Directions." U. S., ; 

Educational Resources Information Center, ERIC Document, ED" ^ 
104 480, 1973. ^ 

Kuznik, Anthony. Follow-up and Evaluation of draduateg^ (and) Employer 

Evaluation~of Graduates in Minnesota Collegiate-Techoical Education. 
U.S., Educational Resources Information Center, ERIC Document 
ED 107 325, 1972. 
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ERIC DOCUMENTS (Continued) 
REPORTS (Continued) 

Snyder, Fred A. and others. The Employment of Career Graduates. U.S., 
Educational Resources Information Center, ERIC Document, ED 
065 117, 1972. 

Status of Spring. 1971 Graduates. Portland Community College. U.S., 

Educational Resources Information Center, ED 068 091, September 
1972. 

Willett, Lynn H. and William E. Piland. Employer Evaluation of Occupational 
Programs. U.S., Educational Resources Information Center, ERIC 
Document, ED 078 819, 1973. 

MISCELLANEOUS 

ERIC Clearinghouses (and other Network Components). 
ERIC Microfiche Collections. 

Cohen, Arthur M. "Presentation to the annual meeting of the Southeast 

Region, AERA Special Interest Group in Community College Research 
on Adapting Institutional Research To Changing Student Populations." 
. Boone, North Carolina, July 22, 1975. 



PUBLISHED REPORTS 

Abrams, Charles and William Harris. Project Trace: II Field Test and 

Evaluation of a System to Follow-up High School Graduates Using 
Sampling Technique s. Human Factors Research, Incorporated, 
Goleta, California. January 1974. 

Amarillo College, Graduate Employer FollowTups. AmariUo, Texas. July 
1975. 

Anton, Jane L. and Michael L. Russell with Research Committee of the 
Western College Placement Association. Employer Attitudes 
and Qoinion Regarding Potential College Gradu ate Employees. 
Volume I. May 1974. 

California State Department of Education. A Proposed System for Re porting 
Job Placement Follow-through Data. Sacramento. 1968. 

Dockstader. Kathy and other Members of Employer Survey Sub-committr- 
Employer Evaluation of Occupation Graduates. Moraine Valley 
Community College, Illinois. September 1972. 

' Harris, William and others. Project Trace: Research and Evaluation of 

Foll ow-up Studies of High School Graduates Using Sampling Techniques. 
Human Factors Research Incorporated, Goleta, California. October 
1972. ' i 
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ERIC r )CU1V1ENTS (Continued) 

PUBLISHED REPORTS (Continued) 

Opaeinch, Cheryl. Extending the Model of Program Evaluation. Career 
Graduates and Their Employers. Catonsville, Maryland. 1974. 

Stubblefield, Philip A. An Occupational Follow-Up Study of Selected 
and Employers From the School Term 1971-72 Through 1973-74 
Shasta College. 1975. 

Technical Report Number One. Management Information Systems for 

Vocational Education: A National Ovevvievi. eds. Robert L. Morgan 
and others. North Carolina State University, Raleigh. 1974. 

TRACE - A Descriptive Foloer. 
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